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ABSTRACT 

In thits issue various concepts of economic change are 
examined. Part I looks at economic change as a context for focusing 
on workforce issues. Parts II and III discuss what is being done to 
address this contemporary problem. This issue contains the follov;ing 
papers: "Presidential Perspectives on Economic Change and 
Restructuring: An Interpretation"; "Understanding and Adjusting to 
Economic Change"; "Challenge in Restructuring: Efficiency vs. 
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Conversion Adjustment Demonstration Project" (Mary G. Visher, Deborah 
Kogan); "A Commentary by Secretary of Labor, Robert B. Reich"; "An 
Interview with Salvxitore Zocchini"; "An Interview with Gary K. 

Jackson and John Dryer"; "Economic Reform in the European Union"; 
"The OECD‘s (Organization for Economic Cooperation and Development) 
Employment Study"; "The Persistence of Unemployment in the 
Pos tindustrial Era"; "Labor issues in European Consolidation"; "The 
Political Economy of Borrowing'"; "A Selective Overview of Soviet 
Reform Policies"; "Gorbachev's Perestroika"; "The USSR in the 
Transition Period"; "Some Thinking about E&T (Employment and 
Training) Coordination at the National Level"; "Measuring Performance 
in Prograns and Coordinated Systems"; "More about Performance 
Management"; "Using Performance Standards in Establishing Workforce 
System Accountability"; "Performance Management Systems: Evaluation 
Principles and Standards"; "A Brief, Selected History of Coordination 
Efforts"; "Establishing Comprehensive Workforce Development Systems; 
State-Level Efforts in the 1990s"; "Contemporary Coordination 
Efforts: The Core Data Elements Project"; "Comprehensive State 
Workforce Development Systems"; "The National Governors Association's 
Performance Management Project''; "References on Economic Change, 
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The terms “economic efficiency, revi- 
talization, restructuring and reform* 
have now become well accepted within 
the postindustrial vocabulary — In fact, 
warmly embraced. We freely Insert 
these concepts Into our narrative piec- 
es as if they had been commonplace 
through the centuries and there is ari 
International consensus about their 
meaning. But do they have that consis- 
tent a history and is there agreement 
on how they are defined? The easiest 
answer is “No." 

With many international economists, 
“economic reform" has been summarily 
replaced by “economic restructuring", 
and subsequently adopted by the rest 
of the world. However, the meaning 
continues to vary. This eminently fash- 
ionable phrase may describe an array 
of postindustrial phenomena: 

■ The creation of joint ventures. 

» The merging of previously separate 
businesses and industries. 

* The consolidation of product devel- 
opment thivough new business part- 
nerships. 

a The development of “niche" markets. 

m The expansion or diversification of 
products by a single rriultinational. 

F The downsizing of corporate work- 
forces. 

Causes 

Some of these activities have been 
characteristic of the economies of In- 
dustrialized nations for some time. 

They have fueled economic growth and 
created jobs. However, the postlndustrl- 
al period has brought with it new chal- 
lenges due to heightened international 
economic interdependence. The basis 
for these challenges lies in a number of 
developments: 

M The movement of postindustrial na- 
tions from manufacturing to services. 

■ The revolution in information and 
telecommunications. 

■ The new political positions affecting 
social spending and trade relations. 

■ The increased concern about the 
planet's physical environment. 



B The changed International trade re- 
alities. 

■ The end of the Cold War. 

B The development of advanced high- 

techology products and markets. 

B The new alliances between devei- 

oped and developing countries. 

Distinctions 

In understanding what is meant by 
"restructuring" we need, of course, to 
distinguish between cyclical and non- 
cyclical causes for economic reorgani- 
zation. Reduced domestic demand for 
certain products, trade deficits, and the 
shriiikage of market share in Interna- 
tional competition are largely cyclical 
phenomena. Firms are pushed to re- 
structure by forces over which they may 
have minimal or no control. The other 
restructuring scenario is Influenced 
more by the efforts of management 
and/or labor to increase economic effi- 
ciency and productivity within business- 
es and Industries. 

it is important to recognize also that 
most restructuring efforts are motivated 
primarily by economic preservation, 
whicfi has the effect of staving off the 
mass unemployment that would occur 
with the complete failure of businesses 
— even though it frequently involves 
significant levels of unemployment and 
worker dislocation at the time, and diffi- 
cult readjustments for many of the 
workers affected. 

The reality is that economic compell- 
tion is no longer contained within na- 
tional or regional boundaries. New eco- 
nomic powers have emerged within this 
altered environment, to compete with 
the U.S. for international customers, 
whoso needs and desires have also 
changed. Amencan businesses and in- 
dustries have had to rise to this occasion, 
if they were to support general economic 
health, and the life quality Americans 
have attained since World War II. 

A variety of “restructuring" strate- 
gies had to be designed and tested in 
this context. Some have been success- 
ful in preserving economic progress 
while protecting the gains of the Ameri- 
can labor forcoi and others have not. 
But these new economic methods have 
clearly revised the way American busi- 



nesses operate in the global economic 
marketplace. 

illustrations 

Specific examples of such changes 
are everywhere apparent. We have 
seen unprecedented partnerships es- 
tablished among some of the cable 
television industry's largest companies, 
which will give customers a new range 
of telecommunications products and 
options. These partnerships will not 
only affect wireless communications but 
also one-stop shopping for many ser- 
vices. 

The rise of Hewlett-Packard in the 
computer printer market has been a 
dramatic story. The company now holds 
approximately 65% of the world market 
for inkjet printers, and has retrieved the 
U.S. lead In related technologies. H-P*s 
success has made It one of the two 
fastest-growing major U.S. multination- 
als. The company has attributed its suc- 
Gss to its heavy investment in laboratory 
breakthroughs, its drive to capture mass 
markets and sustain rapid product inno- 
vation and price cutting, its trust in local 
creativity and accountability, and the cut- 
ting of its internal operating costs. 

Military technology has been applied 
successfully, in the absence of the Cold 
War, to domestic and international mar- 
kets. Scientists who helped the Navy 
create a sophisticated submarine-track- 
ing computer system are now applying 
similar advanced digital processing 
technology to the identification of trou- 
ble spots In jet engines, nuclear reactor 
coolant pumps, and electricity-generat- 
ing steam turbines. This translation from 
military to civilian markets has made new 
economic efficiendes possible. 

In the Northwest, we see Oregon's 
restructuring of the timber industry. Tra- 
ditionally, Oregon has been the top tim- 
ber-producing state. The drastic curtail- 
ment of logging in federal forests 
represented a major challenge to the 
state's economy. But Oregon managed 
to produce five billion board feet each 
year using wood from tree farms rather 
than the 300-year-old trees from public 
land, and the mills are producing more 
products out of this timber by using 
parts that were discarded previously. In 
the restructuring process, Oregon lost 
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nearly 15,000 jobs in forest products 
over the past five years, but gained 
nearly 20,000 in high technology busi- 
nesses. 

Dislocation 

Despite restructuring successes, it Is 
clear that the postindustrial period has 
had Its downside. Although we are en- 
joying general economic growth, there 
is a long-term increase in income in- 
equality In the U.S. The trend toward a 
greater gap between the wealthy and 
the poor Is attributed by many experts 
to wage stagnation and erosion, which 
in turn Is correlated with the shift to a 
service economy. Increased interna- 
tional competition, the decline of union- 
ization, and the decline of the minimum 
wage. 

And certainly the downsizing of 
workforces is a major restructuring is- 
sue. Worker dislocation unquestionably 
represents another reason for rising in- 
equality. Cost containment In the inter- 
est of economic efficiency has led to 



permanent job loss. Many of the work- 
ers laid off are skilled high-wage work- 
ers but their occupatlot>al expertise pro- 
vides few If an/ opportunities to 
transition to other occupational areas. 
Many companies havt> tried to ease the 
Impact of downsizing, but markets and 
profit marginc In emerging ©(sonomic ar- 
eas inevitably influenoe the extent of 
downsizing. And In some cases mass 
layoffs have boen Inevitable If compa- 
nie*P are to survive and prosper. Some 
dislocated workers can be retrained 
successfulJy for other occupational 
niches, but frequently at lower wages. 
And some fall into poverty. 

The recent IBM layoffs are an exam- 
ple of tha dislocation often im^oived in 
corporate restructuring. Cray Research 
Inc., a supercomputer maker, recently 
laid off 1 ,000 workers to cut its manu- 
facturing costs. American Express 
planned to eliminate as many as 6,000 
jobs in an effort to recover from several 
lean years, and to save $500 million in 
expenses which could be used to reor- 



ganize and finance new prodticts. Mat- 
tel! Inc. recently announced a restaic- 
turing plan that would eliminate 4.5% of 
its woridorce, which was expected to 
reduce Matteli's expenses by $25 mil- 
lion fn 199B. In 15)94, Kmart planned to 
dose 110 stores and eliminate ^,000 
jobs, including 10% of its managenal 
positions, related to its loss of market 
sharo to competitors. The Bo^ng Com- 
pany’s own sesl^is of layoffs was due 
both to roducad customer demand 
restructuring In the interest of retaining 
a competitive edge in world aerospace 
markets. And these are but few of the 
many examples of companies that have 
had to Jnciude -riyoftc In their Oiforts to 
raorganize and cemr/ote. 

in this Issue of fJva!uation Forum, ws 
explore some of I'na issues raised in 
this introduction. In Part ( we look at 
economic charge as a context for fo- 
cusing on woMorce Issues. In Parts 11 
and III we look specifically at worker 
dislocation and what is being done to 
address \hix\ contemporary problem. 



Economic Change and Displacement 



'Editorial lritf:6 



The purpose of Part I of the Features 
Section Is to provide some background 
information on the recent evolution of 
the American economy, the influence of 



the international economic environment 
on that development, and the impact of 
economic change on workers affected 
by it. In serving this purpose, wo pro- 
vide a number of perspectives, from the 
President’s to those of various econo- 



mists specializing in restructuring and 
dislocation issues. We conclude Part ! 
with a guest review of three important 
books that focus more exclusively on 
worker dislocation. 



Presidential 
Perspectives on 
Economic Change 
and Restruc.uring: 
An Interpretation 

Perhaps the most significant public 
policy issue of the 1990s has been gov- 
ernment’s response to economic 
change — to the cyclical changes we 
have come to accept and tolerate as an 
inevitable characteristic of a free mar- 
ket economy, and the economic restruc- 
turing that has been occurring in this 
period of international competition. 

The former has produced variations in 
employment. Frequently the latter has 
resulted in permanent job loss and 
worker dislocation. 



The knowledge and understanding a 
president possesses about the economy 
and its larger context, Oiid his policy 
positions and perspectives on economic 
issues, influence policy development in 
a uniquely powerful way within the 
framework of a tri-partite governing 
structure. This president has paid un- 
usual attention both to economic prob- 
lems and economic development possi- 
bilities, to the role of the U.S. in the 
global economy, to domestic workforce 
development, and to ways in which 
government and the private sector can 
work together to assist workers placed 
at risk in a new economic environment. 

Therefore we begin this section with 
insights drawn from an anthology of 
President Clinton’s speeches prepared for 
users by the White House Press Office, 
excerpting from that anthology and com- 



municating key themes with the intent to 
reflect as accurately as possible what ideas 
were conveyed through tliat medium. 

Economic History 

In n marks at the signing of the NAF- 
TA side agreements in September, 

1993, President Clinton commented that 
after the second World War we refused 
to let history repeat itself. Rather the 
United States and other Western powers 
came together to shape a new era. The 
American economy was rebuilt. NATO 
was established. We carried out the 
Marshall Plan to reconstruct war-rav- 
aged nations abroad. New institutions 
were formed to foster peace and pros- 
perity — > such as the United Nations, the 
International Monetary Fund, the World 
Bank, and the General Agreement on 
Tariffs and Trade. 



ERIC 



10 



Evaluation Forum • l^sue 11 • Summer 1995 







These actions, the Ptesident said, 
helped to usher in four decades of robust 
ecoiwmic growth and collective seoidty. 
Yet the CoM War drsining — we 

had devotes trilSiorts of dollars to it. 

Mow tlw Soviet Uaion had disintegrated. 
Tije nuctear shadow was receding vdth 
Slar* / aifd U. Democratic goverranenis 
v/ere emer^rig around the v/orld. 

The I'.'esident rctssinded his audience 
that at the end of World \¥as II sai utj- 
chaliecged America was protected by 
tlie oceans and by our technological svi- 
periority. Wc chose, then, he said, to 
help create a world of free hade sup^ _ 
ported by institutions that would facili- 
tate it. Global trade subsequently grew 
from $200 biliiosi in 1950 to $1500 bil- 
lion in 1980. As a result, jobs wer^ cre- 
ated. That decision to create a system 
of expanded, freer global Srsde played a 
major role, he believed, in producing 
the prosperity experienced by the U.h. 
middle class after World War II. 

This new period of history repre- 
sented a world America helped bring 
into being, he suggested through the 
period of the Civil War, two world 
wars, the Cold V/ar, the establishment 
of global economic and trading mis - 
sions, and the efforts to build a family 
of nations and establish other instru- 
ments of peace and harmony, of 
progress and democracy. 

But the President also acknowledged 
that Americans were continuing to raise 
central questions about our place and 
our prospects in this new world we had 
done so much to produce. They were 
asking questions such as “Will we and 
our children really have good jobs, 
first-class opportunities, a world-class 
education, quality affordable health care, 
safe streets?” Al^r having fully defend- 
ed freedom, he realized, they want to 
know if they will share its bounty. 

For the last two decades, he said, the 
middle class that was created and en- 
larged by these policies had been under 
stress due to changes in the global en- 
vironment, the growth of technology, 
and increasing economic competition. 
If we had learned anything from the 
collapse of the Berlin Wall and the fall 
of the governments in Eastern Europe 
and the former Soviet Union, he com- 
mented, it was that even a totally con- 
trolled society cannot resist tlie winds 



of change which economics, technolo- 
gy and information flow have imposed. 

When you live in a time of change, 
he remarked, the only way to recover 
your security and to broader?, your hori- 
zon was to embrace change, adapt to it, 
and move forward. The only way we 
could recover the fortunes of the mid- 
dle class, so that people who worked 
harder and smarter could at least pros- 
psi more, he believed, was to adapt to 
the many changes that were occurring. 

He encouraged the audience to rec- 
ognize how far we haa moved from an 
industrial age built on gears and sweat 
to embrace an information age demand- 
ing skills, learning and fle.\ibility. In 
this process, record numbers of Ameri- 
cans were succeeding in the new global 
economy. The economy had generated 
almost six miUion new jobs since 1993. 
We had the lowest combLied rate of 
unemployment e.nd inflaiioii in twenty- 
five yea^s. Businesses were more pro- 
ductive, We had brought the deficit 
down to expand trade and give citizens 
more of the tools they needed to obtain 
an educatiou imd to rebusSd their coiit- 
munities. 

Worksrs, Families a.td 
Communities in tho 
New Economic Era 

However, the Pre.rident also .stated 
in his lemarks at the NAFTA signing 
that while the nation as a whole had en- 
joyed peace and prosperity in tliis era, 
too many people were working harder 
for less, vhiile businesses were restruc- 
turing and growing more productive 
and competitive, too many people still 
could not be sure they had a job next 
year or even next montii. And far more 
than our material riches were threat- 
ened, he insisted — our children, our 
families, our values were at risk. The 
common bonds of community which 
had been the great strength of our 
country from its beginning had become 
badly frayed. 

Speaking at American University in 
the winter of 1993, the President point- 
ed out that we were woven now inextri- 
cably within the fabric of a global 
economy. Imports and exports, which 
accounted for about one in ten dollars 
now represented one dollar in every 
five. Nearly three-quarters of the things 
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made in America were subject to com- 
petition at home or abroad from foreign 
producers and foreign providers of ser- 
vices. Whether we saw it or not, our 
daily lives were touched evsti''where by 
the flows of commerce that crossed na- 
tional borders. Capital clearly had be- 
come global. Services had become glo- 
bal. Information had become global 
This was his message. 

His position was that the economy 
was now so globalized and change so 
institutionalized that no government of 
any nation could proimise to protect 
people from the changes in the world 
econoiiiy. 3o if change was inevitable, 
ws had to help people view change as 
our friend rs-ther than our enemy, a 
source of security rather than a source 
of insecurity. And we lad to do that in a 
way tltat promoted those irisututiens of 
society' tliat were most important to us, 
prindpaliy our families and communities. 

The changing nature of work, he 
said, was placing enormous demands 
on working people. The average work- 
er today in every kind oi work had to 
be able vo work with more information, 
to be more creative, to solve more 
problems on his or her own initiative. 
Therefore, the President said, we had to 
transfer more responsibility to v/orkers 
at the grass roots level. They had to 
leam more skills, and process and ana- 
lyze more information than ever before. 
Since every American had to face these 
forces, and every American family aid, 
he felt the job of government ought to 
be to empower people to make the most 
of such forces. 

When the family is under economic 
stress, he proposed that workers within 
families either had to leam more and 
become more productive, get a better 
job, or work harder for less, trying to 
be as sturdy and resilient as the times 
are. The latter was what had happened 
to millions of American families for the 
last twenty years, he said — working 
harder for less. The average working 
family was spending more hours at 
v/ork today than twenty-five years ago, 
for about the same hourly wages, ad- 
justed for inflation. 

The President saw 1973 as the wa- 
tershed year in .American life. From the 
end of World War II until 1973 family 
income doubled. We lived in an era of 
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prosperity that we almost came to take 
for graiited. The middle class grew ever 
larger aad more secure* People just as- 
sumed that they could obtain jobs they 
would hold for a lifetime, that they 
Vi^ould always do better every year than 
they had the year before, that they 
would be able to afford to send their 
diildren to college, have a comfortable 
retirement, own their own house, and 
take care of their paresftts. But tlie reali- 
ty was, he said, that since 1973 most 
Americans had worked increasingly 
harder for the same or lower incomes. 

He had other disrorbing information 
to convey. B'Ctween 1972 and 1992, 
while the work year becanie longer for 
most Americans, \vages stagnated. The 
75% of people who did not have col- 
lege degrees felt it profoimdly. Those 
who began but did not finish college 
saw their wages fall by 9% Just since 
1979. For those who did not go on to 
college, wages fell 17%. And although 
he pointed out that the U.S. traditional- 
ly generates new jobs through interna- 
tional trade, he also recognized that 
some were lost each year to competi- 
tion from countries with lower wages 
or higher qurdily, or vSornetimes unfair 
trade practices. 

Median family income today, he 
added, was only $1,000 higher than it 
was twenty years ago. And more signif- 
icant, the growth in tricorne inequality 
between those who were educated and 
those who were not had escalated dra- 
matically. Even though there were 50% 
more people in the work force of mi- 
nority origin with four years of college 
or more, the aggregate racial gaps in in- 
come were deeper because the educa- 
tion gap had grown so great and be- 
cause inequalities in income had 
escalated in the last several years. Once 
Americans looked forward to doubling 
their living standards every 25 years. 

At present productivity rates, it would 
take 100 years to double living stan- 
dards, he predicted — until our grand- 
children’s grandchildren are bom. 

Out society, he said, had suffered 
unbelievable stresses, as broken homes 
and unwed mothers had become more 
commonplace. In places devastated by 
poverty and despair, we had seen the 
absolute collapse of families and work 
itself, and of the sense of community. 




And into that vacuum had rushed 
gangs, drugs and violence. 

Acknowledging that it was difficult 
to maintain a sense of security and opti- 
mism that a country like ours needed in 
order to lead the world into the future, 
he identified a plethom of needs: 

» The need for pro-family policies, 
like the family and medical leave 
policy enacted into law. 

M The need to pass humane welfare re- 
form that encouraged people to be 
successful parents and workers. 

■ The need for a national network of 
manufacturing extension centers to 
help small firms accomodate to new 
challenges and acquire new technol- 
ogies. 

K The need for telecommunications re- 
forms that would help the U.S. de- 
velop the informatioi, superhighway. 

» The need to reform U.S. job training 
programs, especially the unemploy- 
ment system. The President remind- 
ed Hs audience that eighty percent 
of the people losing their jobs today 
do not get called back to their old 
Jobs. We had become locked into a 
1 950 *s system when we needed one 
for the 21st century that encouraged 
continuous retraining and place- 
ment in the work force. 

International Trade 
and the Economy 

The President also commented that 
open and competitive commerce would 
enrich us, spur us to innovate, force us 
to compete, connect us with new cus- 
tomers. His perspective was that trade 
promotes global growth without which 
no rich country could hope to grow 
wealthier. It enabled our producers to 
prosper, who were themselves consum- 
ers of services and raw materials. 

He understood that many Americans 
were worried that expanded trade 
would move jobs out of the U.S. be- 
cause of tlie difference in wage rates. 
They had seen this happen. But the 
President pointed to the eighteen out of 
nineteen serious economic studies by 
both liberals and conservatives that had 
concluded that there would be no net 



job loss. Businesses do not choose lo- 
cations based solely on wages, he said. 
They choose them on the basis cf the 
skills and productivity of workforces, 
on government attitudes, on roads and 
railroads to deliver products, on the 
availability of maiicets for those prod- 
ucts. Those locations were our strength, 
he believed. 

Some of the specific provisions in 
NAFTA, he said, were important in that 
respect — for example, provisions that 
removed some of the current incentives 
for people to move their jobs across the 
border, making it harder than before for 
businesses to relocate solely on the ba- 
sis of veiy low wages or lax environ- 
mental niles. The environmental agree- 
ment applied trade sanctions against 
any of the countries that failed to en- 
force their own environmental laws. 

The agreements also ensured tliat Mex- 
ico would enforce its laws in areas such 
as worker health and safety, child labor 
and the minimum wage. Zn addition, 
they protected our industries against 
unforeseen surges in exports from ei- 
ther one of our trading partners. 

In his view, we had now created a 
trade agreement that moved beyond the 
traditional notions of free trade, putting 
the environment and human resource 
considerations at the center of this and 
future trade agreements. At the same 
time, the President felt such trade 
agreements imposed new obligations 
on American government. Government 
was obligated to make sure that U.S. 
workers were the best prepared and 
trained in the world. 

We nov/ know, he said, that the av- 
erage 18-year-old American will 
change jobs up to eight times in a life- 
time. Over the past ten years, for the 
firsi time in history workers losing tlieir 
jobs often found they could not return 
to their old job and had to find a new 
occupational niche. Consequently gov- 
ernment needed to develop a new reem- 
ployment system to replace the tradi- 
tional unemployment system. We had 
to be able to tell that subset of workers 
who became dislocated by more open 
trade policies that there was a job train- 
ing and reemployment program avail- 
able to them. 

Once we had put our own economic 
house in order, he said, we must make 
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trade a priority element of American 
security, part of an integrated economic 
program. Then we must do our best to 
exercise leadership among the major fi- 
nancial powers to improve our coordi- 
nation on behalf of global economic 
growth. 

Also, he proposed, we must promote 
the steady expansion of growth in the 
developing world, not only because it 
was in our interest but because it would 
help these countries as well. These di- 
rections, he said, constituted an agenda 
for American action in a global econo- 
my, as well as for our own prosperity. 
Therefore the best investment we could 
make, he was convinced, was in the 
one resource rooted within our own 

— in the education, skills, rea- 
soning capacity and creativity of Amer- 
icans. 

American Economic Progress 

In February, 1 993 , speaking to a 
Joint Session of Congress, the Presi- 
dent explained that a number of condi- 
tions over the 1980s had brought us to 
a point of decision: two decades of low 
productivity, low growth and stagnant 
wages; persistent unemployment and 
underemployment; years of huge gov- 
ernment deficits and declining investment 
in our future; exploding health care costs 
and lack of coverage for millions of 
Americans; legions of poor children; and 
education and job training opportunities 
inadequate to the demands of an unusu- 
ally competitive global economy. 

The economic plan he recommended 
for turning this around involved four 
fundamental components: a shift of em- 
phasis from consumption to invest- 
ment; honoring work and family in ev- 
ery part of our public decisionmaking; 
reducing the federal deficit honestly 
and credibly, and earning the trust of 
the American people by paying for ^is 
with cuts in government waste and in- 
efficiency, in government spending, 
and with fairness to those bearing the 
burdens of these changes. 

He felt the key elements of this ap- 
proach were these: 

■ Reduce the deficit. 

« Expand trade and intensify U.S. 

government efforts to become a 

partner with the private sector in do- 
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ing business beyond our borders. 

■ Increase our investment in education 
and training — and in technology 
and defense conversion. 

B Bring the benefits of free enterprise to 
areas which have been isolated fix>m 
it, in our inner cities and rural areas. 

■ Make the federal government more 
efficient and effective. 

Implementing these strategies, he 
believed, would require a much more 
aggressive, innovative partnership with 
the private sector. Government does 
not have the capacity to “save” the U.S. 
economy in an economic environment 
that is global in scope, he said. But gov- 
ernment can create the right climate, the 
right conditions, and can empower peo- 
ple so that they can compete by taking re- 
sponsibility for themselves and their fam- 
ilies. He felt that increasing changes in 
the world made this imperative. 

The President indicated we were not 
alone in facing economic problems in 
this new era. Every advanced country 
was experiencing a common phenome- 
non: even as economies grew, there 
were pockets within them that had not 
been benefited by economic recovery, 
where investment had not taken hold, 
where jobs had not materialized. This 
was particularly true for inner cities 
and isolated rural areas.The first thing 
we needed to do in the U.S., he sug- 
gested, was to change the job mix, in- 
creasing the proportion of high-skill, 
high-wage jobs.^And we needed to pro- 
vide special incentives for people to in- 
vest in isolated areas, using empower- 
ment zones, the enterprise community 
concept. 

In 1994, according to the President, 
we found ourselves in the midst of the 
first investment-led, low-inflation, pro- 
ductivity-driven economic expansion in 
three decades. Something fundamental 
was beginning to happen, he was con- 
vinced — “ more than half the new jobs 
created by our economy in 1994 were 
above the average wage. This was more 
high-wage jobs in one year than in the 
previous five combined. Investment in 
new equipment was eight times what it 
had been in the previous four years. For 
the first time since 1979 the U.S. led 
the world in the sale of automobiles* 



For the first time in a decade we had 
nine months of manufacturing job 
growth. For the first time in nine years 
the annual vote of international econo- 
mists was that the U.S., not Japan, was 
the most productive economy in the 
world. 

But the President also believed we 
were dealing with some long-term eco- 
nomic problems. The average hourly 
wage in the U.S. actually peaked about 
twenty years ago, and working people 
had been losing their health insurance 
steadily for about ten ' ^ars, the only 
advanced country in tlw world where 
that was the case. So there were genu- 
ine reasons why a lot of hard-working 
Americans did not feel more secure or 
happier with the good statistics and 
growth rates. They were still not sure 
that these numbers guaranteed them a 
good future and a good job, the ability 
to keep their children's health insur- 
ance or put aside money for their col- 
lege education. They were not sure that 
the society was going to be able to 
solve the social problems that violated 
our values and conscience. 

And we had growing poverty. We 
had to find a way, throu^ both public 
and private sources, to enhance the 
lives of the American people who lived 
in poverty, by bringing investment and 
jobs to poverty areas. We could not, he 
said, repair the American family until 
we provided the structure, the values, 
the discipline and the reward that work 
provided. 

We needed to recognize also, he 
said, that well over half the women 
who were mothers in this country were 
in the work force. We had to decide 
that as long as the economy mandated 
this, and the economic pressures of tlie 
time did, we had to find ways for peo- 
ple to be both successful parents and 
successful workers, and ways of orga- 
nizing ourselves differently with regard 
to child care, health care, family leave, 
and the income of people who had chil- 
dren and who worked but still did not 
make enough money to supf>ort them. 

Education and Workforce 
Preparation in a Postindustrial 
Economy 

Speaking at the University of North 
Carolina in 1993, the President pro- 
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posed that economic security could no 
longer be found in a particular job. It 
must be rooted in a continuing capacity 
to learn new things. That condition re- 
quired a system of life-long learning, 
beginning with higher standards for 
schools. Almost two decades ago we 
began education reform efforts that in- 
cluded higher standards, he said. Now 
we were trying to adopt a whole new 
approach in a national effort to raise 
educational standards. This, he felt, 
was an American imperative. At the 
same time he believed we must insure 
that every yoimg person had the oppor- 
tunity to obtain a college education. 

And for the three-fourths of young peo- 
ple who did not obtain a four-year col- 
lege degree, we needed to merge the 
world of learning with the world of 
work, to offer young people classroom 
and on-the-job training. 

In a talk at Rutgers University in 
1993, the President reminded the audi- 
ence that in the midst of World War II 
President Roosevelt proposed the GI 
Bill of Rights, wliich offered returning 
veterans the opportunity for education 
in return for their service to our country 
in war. Thanks to the GI Bill, more 
than eight million veterans received an 
advanced education. Half a century lat- 
er, the enduring legacy of the GI Bill 
was the strongest economy in the 
world, and the broadest, biggest middle 
class that any nation had enjoyed. 

The national service plan, he point- 
ed out, was constructed on the same 
principles, namely that when people 
give something of invaluable merit to 
their country they ought to be rewarded 
with the opportunity to furtlier their ed- 
ucation. The national service plan en- 
abled American students to borrow the 
money they needed for college and pay 
it back as a small percentage of their 
ov/n income over time. The President 
considered this especially important af- 
ter a decade in which the cost of a col- 
lege education had gone up even more 
rapidly than the cost of health care. 

At the 75th anniversary of the 
founding of UCLA in May, 1994, the 
President asked graduating seniors to 
look back at the history of the Constiiu- 
tional Convention, To look at how peo- 
ple assembled wildly different points of 
view and argued heatedly, but always 



with a common love for this country 
and the values of freedom and mutual 
respect. He felt we had to find a way in 
this age and time to restore that kind of 
discourse and that kind of respect. We 
could not afford to engage in the citi- 
zenship of division, distraction and de- 
struction. We had a future to build, 
through education. 

The President had a special opportu- 
nity to talk about the meaning of edu- 
cation for American young people at a 
junior high school in 1994. He ex- 
plained that the Goals 2000 proposal 
embodied ideas gleaned from many 
years of work on educational issues. It ^ 
established what kind of education every 
child needed in every school in America. 

It set out some goals that were expected 
to guarantee that young people would be 
prepared to compete successfully in the 
2 1st century — wherever they were, and 
whether they came fiom poor, middle 
class, or wealthy families. 

One of those goals for the year 2000 
was for every school in America to of- 
fer a disciplined environment condu- 
cive to learning. Another was to in- 
crease the high school graduation rate 
by 90% — an international standard. 

Still another was to make sure that ev- 
ery adult possessed the knowledge and 
skills needed to obtain and retain a 
good job, a job as good as people had 
in othvT postindustrial countries. 

At the signing ceremony for the 
Goals 2000: Educate America Act in 
March of 1994, the President remarked 
that this legislation set world-class ea'u- 
cational standards for what every child 
in every American school should knov\f 
— • for reading and writing, math and 
science, history, geography, foreign 
languages, civics and economics, and 
the arts. It also said something about 
teachers. We had to prepare them bet- 
ter, enable them to continue to learn. 

And it said something about parents. In 
a world in which families were under 
increasing sti'ess, the President said we 
must find ways to help them become 
more involved in their children’s edu- 
cation. And the legislation acknowl- 
edged that we needed more research and 
innovation so we could generalize the use 
of successjul models and strategies. 

Besides academic standards, the 
President reminded the audience that 



Goals 2000 set national skill standards 
as well, to ensure that our workers were 
better trained. It gave states the flexi- 
bility to meet educational and skill 
standards according to their own needs 
and ideas, stimulating well-planned ex- 
perimentation. He felt strongly that in- 
novations needed to be encouraged and 
rewarded, evaluated for their efficiency 
and effectiveness, and if successful 
adapted for use elsewhere. This would 
be a departure from our past. There had 
never been any national standards. 
There had never been a formal way to 
measure whether or not educational and 
skills acquisition goals were being met. 

In the past, he said, everyone who 
was willing to work could find work. 
Today, more than ever before, whether 
you had a job or not, how much you 
could earn in a job, and what your fu- 
ture was, depended on how much you 
could learn — not just what you knew 
but how much you could learn. Re- 
search was indicating that people who 
graduated from college made twice as 
much as those who did not. The world, 
he said, was increasingly smaller, 
changing very fast. People were con- 
nected financially and by communica- 
tion networks that were unlieard of ear- 
lier. Therefore we had to be able to 
learn new things continually. 

The President’s perspective on our 
future was that we must view ourselves 
more as an extended family, a large 
community, and look at all the people 
in tliis society as an enormous resource. 
If we did so, we would reinvigorate our 
educational and training systems. He 
said we needed to make sure that our 
movement into the 21st century was 
grounded in an old idea, that all Ameri- 
cans have not only a right but a respon- 
sibility to rise as far as their talents and 
determination can take them, and to 
give something back to their communi- 
ties and their country. We needed a 
new set of understandings, he thought, 
about how we can equip people to meet 
the challenges of the new economy, 
how we can change the way govern- 
ment works to fit a different time, and 
how to repair the damaged bonds in so- 
ciety. The future was not an inherit- 
ance, he said. Rather it was an opportu- 
nity and an obligation, something every 
generation had to create. 
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Understanding and 
Adjusting to 
Economic Change 

Economists’ perspectives on the 
economy, how it works, how it is 
changing, differ with their theoretical 
training and orientation. Although this 
intellectual attribute confuses us, it also 
expands our minds. In this article we 
look at perspectives embodied in sever- 
al chapters of a book published by the 
Urban Institute, Rethinking Employ- 
ment Policy, edited by D. Lee Bawden 
and Felicity Skidmore. The book is one 
in a series of publications sponsored by 
the Institute’s Project on the Federal 
Social Role fimded by a number of pri- 
vate foundations. Although the book 
was written in 1989, prior to additional 
changes in the American economy and 
the role of the federal government, its 
insights nevertheless apply usefully to 
the 1990s. 

The book takes a retrospective look 
at what is known and remains to be un- 
derstood about dealing with domestic 
and international issues facing the U.S. 
labor market in this decade. The chal- 
lenge the editors pose at the beginning 
of the book is to find a method for 
1) maximizing the potential of our 
workforce without creating inflation, 
and 2) targeting job training and em- 
ployment programs to those who can 
benefit the most from them, so that our 
resources are used efficiently. 

Bawden and Skidmore identify two 
major themes that guide the book. One 
is that U.S. employment i^licy has not 
met the goals envisioned in the early 
1960s as achievable. The other is that 
we now know enough from analyses 
and research that shaping a more effec- 
tive future employment policy is possi- 
ble and should be done. 

Employment Policy History 

In their introductory chapter, the ed- 
itors suggest that the employment and 
training policies of the 1960s and early 
1970s, which represented a policy 
change as well as increased funding, 
generated a new interest in identifying 



and addressing the problems of disad- 
vantaged workers, the structurally un- 
employed, and those experiencing dis- 
crimination in the labor market. 

There was a significant expansion of 
programs to train and retrain workers, 
increase UI benefits, create public ser- 
vice jobs, and ensure equal opportuni- 
ty. Even though the problems that 
prompted this policy change have not 
faded away, the times have changed, 
they point out. In the 1980s, the combi- 
nation of a conservative president, fis- 
cal pressures to cut budgets, and nega- 
tive public perceptions of certain 
programs shriveled employment policy. 
The editors predict prophetically in this 
introduction that the American public 
is not likely to support a more aggres- 
sive and expansive policy, if based on 
the full array of past strategies. 

Meanwhile, they insist that some of 
the troublesome problems of the past 
remain to be solved. In fact there is 
more concentrated structural unem- 
ployment, expanded underemployment, 
an increase in worker dislocation, and 
continuing discrimination in the work- 
force. They propose that the solutions 
to these problems must be crafted in the 
context of important social, economic 
and demographic changes that have 
taken place since the 1960s, and must 
take advantage of what has been 
learned over the past several decades. 
The changes they claim we must re- 
spond to are these: 

■ Changes in the composition of the 
workforce — that is, more older 
workers and women — requiring the 
adjustment of retirement policies, 
wage structures, working hours, and 
services such as child care. 

■ Changes in equal opportunity and 
affirmative action policies respon- 
sive to less overt, more subtle forms 
of racial and sexual discrimination. 

■ Changes in our educational system, 
given that over one-fourth of the 
adult population lacks a high school 
education, and may lack the basic 
skills that support training and re- 
training for the expanding high- 



technology and service jobs of the 
future. 

■ Changes in our approach to poverty, 
given growing income inequality. 

These changes provide the context 
for the perspectives of other economists 
in Rethinking Employment Policy, 

Ray Marshall*# Perspective 

Former Secretary of Labor, Ray 
Marshall, concentrated his chapter on 
“The Implications of Internationaliza- 
tion for Labor Market Institutions and 
Industrial Relations Systems.” It is 
Marshall’s thesis that the international- 
ization of economies and the globaliza- 
tion of markets between 1950 and 1980 
have been the most important economic 
trends since World War II. He supports 
this contention with adequate evidence. 
By 1987, he says, over half of U.S. cor- 
porate profits derived from overseas. 
International trade accounted for one- 
third of all U.S. cropland, one-fourth of 
farm income, and one-sixth of all jobs. 
Nearly 70% of all goods manufactured 
in the U.S. was competing with im- 
ports. Close to 25% of the grovrth in 
the U.S. workforce during the 1970s in- 
volved immigrants and refugees. 

These changes, he says, have altered 
the effectiveness of traditional macro- 
economic policies. Tlie integration of 
markets globally has transformed labor 
market institutions and industrial rela- 
tions systems, as well as influencing 
management practices. 

The Evolution of Economies 
Since World War I! 

Marshall explains that after the 
WWII, governments viewed an open, 
expanding trading system as the best 
way to encourage the growth of world 
economies. Many experts had linked 
protectionism and trade restrictions 
with the Great Depression and the war 
itself. As a preventive measure, the 
U.S. and other countries worked to- 
gether to form institutions, policies and 
procedures to encourage and maintain 
international trade and finance. This 
free-trade system became known as the 
Bretton Woods system. 
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It was organized aiound three basic 
principles: I) free trade, 2) fixed ex- 
change rates, and 3) autonomy in do- 
mestic economic policy. The world's 
welfare was considered to be increased 
by a ccmpetitive, free-trade, open-mar- 
ket system in which each nation would 
concentrate on producing things which 
would give it the greatest or the least 
advantage economically. This idea was 
referred to as “the doctrine of compara- 
tive advantage.” 

Alongside this doctrine, a critical in- 
fluence was the power of the U.S., ac- 
cording to Marshall. Our domestic 
economy had been strengthened by 
World War II, having benefited from 
technological development during the 
war, which supported an enormous 
growth in productivity and total output. 
This economic dominance translated to 
policy dominance. It was therefore in 
our national interest to advocate for a 
relatively open and expanding world 
economy. 

But even as the Bretton Woods sys- 
tem encouraged growth in the interna- 
tional economy through the 1960s, cer- 
tain events were to begin to tear it 
apart, Marshall explains. These were 
some of those events: 

o The abandonment of the fixed ex- 
change rate system. 

« The massive increase in foreign in- 
vestment and related flows of capi- 
tal. 

■ The growth of the Eurodollar market 
(dollars held and traded abroad). 

■ A large increase in U.S. debt and the 
debt of non-oil-producing develop- 
ing nations. 

■ Large-scale movements of workers 
among countries in response to em- 
ployment and income opportunities. 

Some Implications of 
Internationalization 

Marshall sees both positives and 
negatives in this internationalization of 
markets. The positives are increased ef- 
ficiency and expanding knowledge, 
which raised living standards. The neg- 
atives are the destablizing influences 



accompanying this development. Inter- 
national economic rules that worked for 
the 1950s and 1960s no longer applied. 

Countries are not as effective in di- 
recting their policies concerning the in- 
ternational economy, Marshall says, 
and the effects of domestic economic 
policies have changed. The impact of 
economic stimuli in a period of eco- 
nomic depression, for example, limits 
domestic economic expansion by in- 
creasing foreign imports — a serious 
problem for the U.S. during the 1981- 
1982 recession when foreign imports 
cut into increased demand. And the 
consequences of U.S. budget deficits 
are not under as much control. This 
lowers U.S. living standards and can 
raise inflation, he says. It also forces 
other countries to keep their interest 
rates high. These destabilizing effects 
have brought pressure on policymakers 
to reconsider the Bretton Woods sys- 
tem. 

The reality has strayed from this sys- 
tem's theoretical underpinnings. Com- 
petition, Marshal says, does not direct 
domestic markets, therefore countries 
do experience unemployment. There- 
fore many industrial countries have 
now supported strategies that both cre- 
ate comparative advantage and improve 
the industry mix. And Marshall claims 
that economic activity is now based on 
national and enterprise strategies, not 
simply on the interaction between 
short-run market forces and the maxi- 
mization of profits. 

Japan, for example, is more interest- 
ed in strengthening national power, 
productive capacity, and market share, 
he says, than in “short-run profit maxi- 
mizing.” Also, economic change is not 
gradual, Marshall points out. Trade is 
no longer limited to “goods at the mar- 
gin.” Whole technologies are exported, 
and countries share the production of 
products. The result , he says, is poten- 
tial job loss, wage suppression, and less 
satisfactory working conditions. 

The Potential Loss of the 
U.S. “Competitive Edge” 

Marshall reports that the President's 
1985 Commission on Industrial Com- 
petitiveness conveyed a dour assess- 



ment of the American economy — that 
business and industry's ability to com- 
pete successfully in world markets had 
been declining for over twenty years, 
even in high technology sectors. Con- 
clusions from other analyses elaborated 
on this assessment. Marshall cites two 
studies in the mid-1980s by the Brook- 
ings Institution and the New York 
Stock Exchange that reach ether con- 
clusions. These were the major find- 
ings: 

■ An overvalued dollar, due to huge 
U.S. budget deficits, is the main 
cause of our economic problems. 
Given this scenario, the analysts 
concluded that the economic boom 
of the 1950s and 1960s was “abnor- 
mal” and the economy would return 
to “normal” as soon as the budget 
was balanced. 

■ Trade was the factor most responsi- 
ble for a net increase in jobs in the 
1970s — we gained mc“^ employ- 
ment from trade tiian we lost to it. 

■ Trade was not the main reason for 
declining employment even in the 
industries experiencing the greatest 
declines. 

• U.S. industrial performance was 
strong relative to other countries — 
first or second in the world in 23 out 
of 40 manufacturing industries in 
1982. 

■ Most job losses were concentrated in 
four key depressed industries which 
accounted for only 20% of total 
manufacturing output. The 36 indus- 
tries that dominated manufacturing 
actually added jobs between 1977 
and 1982. 

■ The growth in productivity had been 
slowing sinVe the 1960s, but in man- 
ufacturing it had been particularly 
strong. 

In this generally more optimistic 
perspective, poor production perfor- 
mance was seen to be correlated with 
energy price shocks, inflation and eco- 
nomic uncertainty, none of which were 
thought to interfere with performance. 
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The analysts pointed to the expansion 
of real plant and equipment spending, 
increased funds for research and devel- 
opment, increased efficiency due to the 
accumulation of work experience by 
baby boomers, a better educated work- 
force, and a significant improvement in 
labor-management relations tied to the 
need to become more competitive. 

But there was a remaining residue of 
pessimism, exemplified in the Harvard 
Business School’s analysis. The main 
conclusions, according to Marshall, 
were the following: 

H A more realistically-valued dollar is 
not the answer, because the structure 
of trade has changed. The economic 
recovery from the 1981-1982 reces- 
sion has led to slower growth in ex- 
ports and faster growth in imports 
than in previous recoveries. The re- 
turn of business assets has failed to 
keep pace with the rising cost of 
capital. 

■ Energy prices were an important 
factor in trade deficits in the late 
1970s and 1980s, but there was also 
a decline in non-energy trade bal- 
ances as well. 

■ Market share in constant dollars is 
not the only, or the most significant 
measure of economic performance. 
Performance is determined also by 
the relative values of exports and 
imports. Our share of total world ex- 
ports has declined. 

♦ The U.S.’s share of high-technol- 
ogy exports has fallen also. 

♦ U.S. productivity growth has 
been far below our competitors, 
even though their economies 
have remained depressed. 

The pessimists have discounted 
many of the optimists’ tenets, indicat- 
ing that the evidence shows that in 
manufacturing, productivity growth has 
deteriorated “despite improvements in 
both capital formation and capital-labor 
costs.” 



Marshall’s Viewpoint 

Marshall draws from both perspec- 
fives, acknowledging that the U.S. is 
still the strongest world economy and 
likely has the highest average produc- 
tivity levels, even though we appear to 
be losing that advantage rapidly. He be- 
lieves that macroeconomic policies and 
the expensive dollar are important fac- 
tors. But he thinks the pessimists are 
correct in being concerned about main- 
taining market positions “without sacri- 
ficing return on assets, or real wages or 
incomes” — that is, he feels our living 
standards are going dovm. His position 
is that analysts are on tai-get in taking 
seriously how v/e are doing vis-a-vis 
countries like Japan. Productivity 
growth is the key to mamtaining com- 
petitiveness, in Marshall’s mind, and 
tlierefore for sustaining high wages and 
profits. 

He also sees the composition of in- 
dustry as an important influence. Stud- 
ies that treat all industries the same are 
missing critical information, he says — 
“there are dynamic and symbiotic rela- 
tionships between production activities 
and technology transfer.” Also, he re- 
minds us that the linkages between eco- 
nomic activities and technology are cu- 
mulative. A lack of competitiveness in 
key industrial sectors may lead to their 
loss, which then removes from remain- 
ing businesses the technological sup- 
ports, the learning accumulated, and the 
networks developed that are required 
for them to stay competitive. 

Marshall’s Recommendations 

Having established that the Bretton 
Woods system no longer works in the 
postindustrial era, what does Marshall 
suggest? One answer, he says, is to re- 
strict the growth of the international 
trading system — an answer he rejects 
out of hand. Trade restrictions, he says, 
can worsen economic problems be- 
cause it produces retaliatory action. 

The right answer, in Marshall’s 
view, is to promote an open and ex- 
panding trading system guided by 1) 
internationally acceptable rules that can 
be enforced, 2) international economic 
policies, and 3) international economic 
institutions. Also needed are coordinat- 



ed macroeconomic policies and strate- 
gies that avoid over-valuing the dollar. 
And finally we need to reform our in- 
dustrial relations system, to improve 
economic stability and employment and 
reduce unemployment. 

Most of the features of the Bretton 
Woods system were characteristic of all 
industrial nations, and some of tliese 
features persist. However, Marshall 
teases out certain elements that have 
been unique to the U.S. and must be 
considered in developing a new indus- 
trial relations system: 

■ American unions were considered 
the bargaining agent for all employ- 
ees, whether union members or not. 
However, the legal right of workers 
to vote for or against union member- 
ship created competition for em- 
ployees’ loyalty betv\cen union and 
non-union sectors, and betv/een 
unions and employers. 

■ Collective bargaining was decentral- 
ized, emphasizing wages, hours and 
working conditions in particular 
firms, industries and labor markets. 

H U.S. employers were generally hos- 
tile to unions, despite the affinity of 
the American labor movement for 
the capitalist system and its flexibili- 
ty in responding to the interests of 
employers. 

a A “scientific management system” 
was used by employers which was 
generally authoritarian and adversar- 
ial, allowed only minimal participa- 
tion in decisionmaking by workers, 
and provided minimal job security. 

■ Union politics were not class-con- 
scious, rather they focused on jobs 
and economic security rather than on 
an organizational or political base 
for the working class. 

■ Management felt they had a right to 
lay off workers during economic 
dovWitums since the expectation was 
that busiress cycles would keep lay- 
offs temporary, and the UI system 
would provide adequate temporary 
assistance. 
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o The American system was more 

flexible than most European indus- 
trial relations systems in adjusting to 

change, due to: 

♦ The principle of exclusive bar- 
gaining. 

♦ The more decentralized bargain- 
ing system. 

♦ The lower degree of unionization. 

♦ The greater ease with whidi em- 
ployers could close plants and lay 
off workers. 

♦ The greater openess to immigra- 
tion and imports. 

♦ The greater displacement of la- 
bor, resulting in pools of under- 
employed workers. 

These elements supported a long pe- 
riod of relatively high growth in pro- 
duction and output, and moved most 
union members into the middle class. 
But the system tended to be inflation- 
aiy. The bargaining approach tended to 
raise wages by playing one employer or 
union against another. Long-term union 
contracts with cost-of-living adjust- 
ments and annual increases in benefits 
tended to inflate the compensation 
base. UI and other income maintenance 
programs reduced the impact of labor 
supply on wages, just as multiple wage- 
earner families did. Full employment 
policies reduced employers’ incentives 
to avoid wage increases and unions’ 
willingness to hold them down. As a 
result, Marshall says, insufficient atten- 
tion was focused on the level of pro- 
ductivity and the degree of economic 
efficiency. 

Marshall looks to the Japanese sys- 
tem for answers. These are the major 
characteristics that capture his atten- 
tion: 

■ Highly integrated, consensus-based 
economic policies emphasizing up- 
grading of the Japanese industry 
mix. 

» A management system supportive of 
labor-management cooperation and 
participation. 



M Mechanisms within firms that help 
absorb demand shocks, such as bo- 
nus compensation systems, sharing 
of production with Third World 
countries, subcontracting, and the 
use of temporary workers. 

• The ability to shift resources from 
non-competitive to more competi- 
tive industries. 

B An emphasis on lifetime employ- 
ment, continuing education, the con- 
centration of collective bargaining at 
the enterprise level ratiier than at the 
industry or sectoral level, and the 
annual adjustment of wages (pre- 
cluding internal competition on the 
part of employers and unions.) 

» Heavy emphasis on consensus- 
building at every level, rather than 
on detailed regulations, 

o A bonus wage payment system that 
keeps wage increases in bounds. 

■ A flexible job assignment and train- 
ing process that increases workers’ 
job security and employers’ willing- 
ness to finance long-term education 
and training for their employees. 

But Marshall does not leave us here. 
He points out that the U.S. has higher 
overall productivity and living stan- 
dards than Japan, and some sectors of 
the Japanese economy, he says, are not 
particularly productive or efficient. 
Nevertheless, the Japanese system pro- 
vides rising real incomes and much 
more job security. And it is more egali- 
tarian in terms of income differentials. 
Beyond that, Japanese workers see a 
strong relationship between improve- 
ments in productivity and the employ- 
ment benefits they receive, which gen- 
erates a considerable incentive. The 
cooperation between public and private 
sectors makes it possible for businesses 
to be satisfied with lower rates of re- 
turn, which then encourages long-term 
planning. 

Marshall’s diagnosis of our prob- 
lems and possibilities has garnered 
wide support from other respected 



economists, is generally supported by 
the Administration’s economic and in- 
dustrial relations system reform ideas, 
and has been taken seriously by the 
larger corporations. However, the im- 
pact of these ideas on reducing disloca- 
tion has yet to be determined. 

Another Perspective: Goals for 
Natiioniwt Employment Policy 

Isabell V, Sawhill’s perspective on 
economic issues is also enlightening. 
She defines four goals for employment 
policy: 

■ The provision of jobs — i.e, the re- 
duction of unemployment. 

■ The creation of more good jobs — 
i.e. the improvement of productivity 
and earnings, 

■ The provision of assistance to the 
disadvantaged — i.e, making the 
poor more self-sufficient. 

■ The improvement of the functioning 
of labor markets using means that 
guarantee economic efficiency and 
the fair treatment of workers. 

She views these goals as sei*ving 
dual purposes: human welfare in soci- 
ei/, ::^*i the economy’s long-term 
growth and productivity. The strategies 
she recommends for achieving the four 
goals are these: 1) macroeconomic pol- 
icies; 2) job creation policies, such as 
subsidized employment in the public 
and private sector; 3) education; 4) in- 
comd transfers; and 5) government reg- 
ulation. She considers the public educa- 
tion system the strategy of choice for 
creating better jobs through improved 
productivity. In providing jobs overall, 
macroeconomic policies are primaiy, 
she believes. Income transfers are im- 
portant in assisting the disadvantaged, 
even though concern about work disin- 
centives and long-term dependence re- 
main. 

With respect to the goal of improv- 
ing the functioning of labor markets, 
she gives attention to worker protec- 
tions and benefits — that is, to protec- 
tive labor laws; anti-discrimination 
laws; job security; retirement, disability 
and unemployment insurance; pension 
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rights; and notification of layoffs. 

While the protections and benefits are 
of critical importance to workers, she 
says, they may also reduce economic 
efficiency. Employers find it more dif- 
ficult to adjust to changing market de- 
mand. This is the perennial tension be- 
tween equity and efficiency that 
economists have been struggling witli 
since Adam Smith. 

Resolving Problems 
in Meeting Goals 

What Sawhill suggests is that we find 
more flexible and less costly methods 
for resolving the tension, weighing 
costs vs. benefits more carefully. The 
current labor market and industrial re- 
lations system, Sawhill says, “evolved 
as a requirement of a modem economy 
built on the principles of specialization 
and large-scale production.” These 
principles served us well, she recogniz- 
es, greatly increasing productivity and 
America’s standard of living. 

However, little attention was paid in 
this system to workers’ rights and pro- 
tections, which led to unionization and 
to an array of protections and benefits. 
And the industrial system that initially 
gave us prosperity was ill-suited, she 
claims, for a world in which the labor 
force is educated, workers make de- 
mands, services and information re- 
place standardized goods, and capital 
and technology are widely available. 
These changes have created a climate 
for workplace reform in the direction of 
worker satisfaction and participation, 
and new styles of corporate leadership. 
How successful this nev/ direction will 
be, Sawhill says, is yet to be estab- 
lished. 

Some Conclusions 

One of the most difficult trade-offs 
in achieving the goals Sawhill proposes 
is between employment and wages. 



More Jobs can be created if Americans 
would accept lower wages, she points 
out. Alternatively, wage levels could be 
increased at the risk of greater unem- 
ployment. The choice is more disturb- 
ing, she suggests, in an ecoiiomy that is 
vulnerable to increased foreign compe- 
tition, since our standard of living can 
be greatly influenced by that choice. 

We could, she says, compensate for 
choosing higher wages through a com.- 
bination of 1) trade protectionism, 2) a 
stimulative fiscal and monetary policy 
that reemployed displaced workers, or 
3) a decline in the value of the dollar 
— but these solutions would, she be- 
lieves, lead to an erosion of the pur- 
chasing power of higher wages and de- 
terioiate the standard of living. 

Whatever the strategy, Sawhill feels 
we must make special efforts to assist 
the disadvantaged. Her perspective on 
programs to reduce youth unemploy- 
ment and welfare dependency is that 
adverse economic and demographic 
forces are more responsible for slow 
progress than the programs developed 
'■ for that purpose — and that some of 
these programs have been, in fact, quite 
successful. 

A Brief Comtnentary 

These selected perspectives on the 
economy provide important lesson;, 
about potential relationships between 
economic policies, unemployment and 
dislocation, despite the differences 
among labor economists in the nature 
of the evidence they interpret, their 
conclusions from this information, and 
their recommendations for change. On 
one point there is agreement among 
them: it seems clear that the industrial 
relations system of the 1950s and 
1960s is no longer viable in the 1990s 
and must be revised substantially in the 
context of postindustrial international 
competition. 



A Challenge in 
Restructuring: 
Efficiency Vs. Equity 

In this article we review ideas in two 
books whose topics are relevant to the 
perennial dilemma posed by efforts to 
increase economic efficiency without 
jeopardizing economic equity. Resolv- 
ing this dilemma has important impli- 
cations for worker dislocation, since 
dislocation is frequently a product of 
efforts to increase economic efficiency 
but often leads to increased income dis- 
parity. 

Both books are Brookings Institu- 
tion publications. We first give atten- 
tion to Growth With Equity: Economic 
Policymaking for the Next Century, 
written by Martin N. Baily, Gary Burt- 
less, and Robert E. Litan in 1993. And 
then we turn to A Future of Lousy 
Jobs? The Changing Structure ofU.S. 
Wages, edited by Gary Burtless in 
1990. 

Themes In Growth With Equity 

The authors’ position is that the 
American economy exhibits two worri- 
some trends: slow improvement in pro- 
ductivity growth, and growing income 
inequality. Short-term fluctuations in 
the business cycle and in unemploy- 
ment are not their primary concerns in 
this book — it is long-term patterns 
that concern them: 

■ What will economic recovery mean? 

■ How can we boost the rate of long- 
term growth? 

■ How can income disparities be re- 
duced? 

These questions frame a fascinating 
book that proviaes insights based on an 
increasingly large body of evidence 
about long-term economic performance 
and its implications for equity issues. 
The authors’ approach, they want us to 
understand, is “eclectic’" and “cau- 
tious.” No single policy is envisioned 
as the magic bullet. They view their 
recommendations as modest, in the 
sense that they are designed to increase 
the probability of achieving progress in 
resolving productivity and income ine- 
quality problems. 
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A premise is that appropriate poli- 
cies for increasing economic growth 
and bringing greater equity to the dis- 
tribution of income are inevitably inter- 
related. The economy, they say, can 
grow faster if the low-skilled and low- 
incomed can produce more and higher 
quality goods and services per hour 
worked. Skilled workers, they contend, 
have greater flexibility and mobility, 
which means they can move from de- 
clining to expanding industries with 
shorter periods of unemployment fol- 
lowing job loss. If unemployment is so 
reduced, the economy can be pushed to 
lower levels of unemployment without 
serious levels of inflation. At the same 
time, the problems we associate with 
poverty will not be sapping the econo- 
my if its resources as much. 

With respect to income inequality, 
the authors state unequivocably that 
their interest is not limited to strategies 
that reduce poverty, rather they are 
concerned about changing the condi- 
tions that lead to low earned income 
among the least skilled. However, they 
recognize that some policies that speed 
long-run growth do not support equity, 
and policies that are consistent with eq- 
uity do not necessarily increase eco- 
nomic growth. 

Their main contribution to thinking 
about these complex issues is a com- 
prehemive framework and strategy — a 
mix of policies and programs — for en- 
couraging long-term economic growth 
while maintaining equity. This policy 
model is based on assumptions about 
the underlying causes of slow growth 
and increased inequality, such as: 

■ The impact of oil price shocks over 

the last two decades. 

■ Reduced innovation. 

■ An increase in regulation. 

■ Deteriorating educational perfor- 
mance. 

B Stronger foreign competition. 

■ A stagnant minimum wage. 

■ Declining unionization. 

The model also depends on one’s 
definition of growth and productivity. 



By faster growth, the authors mean 
both a more rapid rate of advance in to- 
tal output and a iaster rate of increase 
in output — “holding constant the 
amount of inputs used to produce that 
output.” A labor force that works more 
intelligently to produce goods and de- 
liver additional services with the same 
amount of work effort is at an advan- 
tage. Advantage is achieved by raising 
labor productivity. 

Economic growth refers to the 
growth of potential output, “the output 
that can be attained when labor and 
capital are fully employed and inflation 
is not accelerating.” Economic srrowth 
is spurred, the authors say, by advances 
in technology, fay improvements in 
workers’ skills, and by progressive 
management practices. When the au- 
thors talk about income inequality, they 
are referring to inequality in pre-tax in- 
comes as well as after-tax incomes — 
in market incomes, particularly wages. 

In commenting on their comprehen- 
sive policy model, they acknowledge 
that the research evidence does not sup- 
port all of their recommendations 
equally well. But this does not deter 
them. Using a mf dical analogy, they 
point out that one cannot always expect 
existing scientific information to pro- 
vide conclusive answers about alterna- 
tive treatments, but this is hardly a rea- 
son to abandon the search for evidence 
or to avoid making policy suggestions. 
And so they do make them! 

An Agenda for Growth 
and Equity 

Three broad themes run through the 
large set of proposals in Uie authors’ 
model: increasing and reallocating in- 
vestment; assisting workers; making 
hard choices;and implementing 
change. The proposals subsumed under 
these themes are organized into several 
policy categories: innovation, labor, in- 
vestment, and trade and foreign invest- 
ment policies. For each proposal in the 
model, there are qualifications: 

« Whether or not the policy contrib- 
utes to economic growth or to eco- 
nomic equity, or to both. 

■ How substantial the proposal’s ben- 
efits may be in resolving one or the 

other, or both. 



* How strung the evidence is from re- 
search and * Xpert opinion in sup- 
porting the wisdom of the proposal. 

Of these proposed policies, labor 
policies are consider^ the most sup- 
portive of both growth and equity. 

The full complement of recommended 
policies is presented in Figure 1. 

The authors’ proposals are designed 
to speed economic change by increas- 
ing productivity grovrth, while easing 
the burdens of change for workers and 
their families. But the authors remain 
humble about the impact of such pro- 
posals, hoping for substantial improve- 
ments if not dramatic results. They are 
convinced it is time to develop a com- 
prehensive set of interelated policies as 
well as for realism. Inaction, they say, 
is an unacceptable strategy. 

The Issue of Earnings Inequality 

Gary Burtless’ edited volume, i4 
Future of Lousy Jobs? speaks directly 
to the equity issue. In the introductory 
chapter, Burtless identifies the prob- 
lem. Over the last two decades, the 
share of all income obtained by the 
richest fifth of families in the U.S. has 
increased by 3.3% to 43.7%. The share 
received by the poorest one-fifth has 
fallen 1% to 4.6%. Incomes of the 
group of families just below the richest 
rose slightly, while the incomes of 
those groups of families just above the 
poor fell. These shifts, Burtless con- 
cludes, have reversed the trend over 
much of the postwar period, a trend 
that saw this gap shrinking. 

Causes of Inequality 

Since the main source of income for 
most Americans is wages, one cause 
for rising income inequality is thought 
to be the decline in middle-class jobs 
with high to moderate wages. Not all 
economists agree that this is the major 
cause, but most agree that average 
earnings growth among production 
workers has stopped in recent years af- 
ter rising strongly over the early post- 
war period. This sharp decline since 
1973 is related, Burtless says, to the 
slowing of productivity growth, but 
again economists are not of one mind 
about why this change has occurred. 
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One problem is defining and measuring 
productivity and wage inequality. For 
example, Burtless proposes that ^ ide- 
al measure of worker compensation 
would include both wages and fringe 
benefits per hour or per forty-hour 
workweek, but the Census does not col- 
lect enough information to calculate 
this. 

Another way to measure inequality 
is to look at the distribution of wages 
and calculate the trend in earnings for 
workers at selected points in the earn- 
ings distribution. This method indicates 
that inequality is rising among men but 
falling or remaining fairly stable 



among women Given this result, one 
could propose that middle-class jobs 
are declining for men, but not for wom- 
en. 

Between 1973 and 1987, the earn- 
ings gaps between well-paid and mod- 
erately-paid workers, and between 
moderately-paid and poorly-paid work- 
ers have grown over time, particularly 
in the 1980s. The number of men with 
earnings close to the median wage level 
has shrunk. Jobs near the middle of the 
male distribution have disappeared. 
Burtless points to two reasons for these 
changes that have been explored by 
economists: 1) shifts in the composi- 



tion or aggregate level of labor supply, 
and 2) the changing pattern of demand 
for U.S. workers. 

Composition and Demand Shifts 

The rise in the number of poorly- 
paid jobs ir.ighr be related to an in- 
crease in employers’ use of less skilled 
labor — but Burtless says this is con- 
trary to the evidence. If employers were 
hiring less skilled workers, the wages of 
these workers would be elevated relative 
to those received by better skilled, more 
educated workers. However, the opposite 
pattern occurred in the 1 980s. Also, job- 
lessness among the less skilled should in- 
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Innovation Policies 

Strengthen basic science research: 

« Authorize oversight on the part of 
the National Science Foundation. 

^ Re-examine the allocation of the 
current federal budget. 

Strengthen precompetitive R&D: 

♦ Fund only projects with private 
sector financial support. 

♦ Fund a broad diversity of projects. 

♦ Create a Civilian Technology Board 



Labor Policies 

H Improve skill training of schools. 

♦ Encourage schools to provide high 
school transcripts to prospective 
employers. 

♦ Require national standardized 
tests. 

♦ Tie compensation and promotion of 
teachers and principals to perfor- 
mance of students on national 
tests. 

Improve skills of current labor force: 



to provide peer review. 

♦ Fund precompetitive research. 

B Promote commercial R&D by dou- 
bling the R&D tax credit. 

■ Lengthen business time horizons: 

♦ Encourage equity ownership by 
bankholding companies. 

♦ Institute tax penalties on executive 
director stock options with short ex- 
ercise periods. 



♦ Establish public-private labor au- 
thority to develop tests and creden- 
tials for non-college occupations. 

. Institute pay-or-piay training re- 
quirement for non-college-educated 
workers. 

♦ Establish national apprenticeship 
program for non-college-educated 
workers. 

1 Establish Improved R&D programs 
for such public training efforts as Job 



Investment Policies 

Raise investment share of total out- 
put: 

♦ Reduce, and ultimately eliminate, 
federal budget deficit. 

Encourage particular types of Invest- 
ment with spillover benefits to the 
rest of the economy. 



■ Enact a permanent 5% income tax 
credit for equipment investment. 

M Spend somewhat more on infrastruc- 
ture, concentrated on upgrading ex- 
isting facilities. 

m Encourage regional, industry “clus- 
ters” by states or localities. 



♦ Institute tax penalties for paying di- 
rectors in cash. 

M Reduce risks of innovation: 

♦ Adopt modest “tort” reforms, ac- 
companied by strengthened R&D 
and enforcement by regulatory 
agencies. 

♦ Continue to allow joint R&D. 



Corps and JTPA. 

■ Encourage firms to link worker pay 
with division of company-level perfor 
mance. 

■ Cushion economic shocks; 

♦ Upgrade national and state employ 

ment services. 

6 Establish a non-cause-related pro 
gram of earnings insurance. 



u Allow banks to meet requirements 
through investments in community 
development banks. 



Trade and Foreign Investment Policies 
Encourage further multilateral liber- > Use liberalized and more rational 
ailzation of trade and foreign invest- treatment under U.S. unfair trade 
ment. 



practice” status as carrot to obtain 
better access to foreign markets. 
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crease under this theory, yet unemploy- 
ment rates for the less sidled have risen 
relative to those more experienced. 

The declining wages of less skilled 
men may be due to a variety of shifts in 
the structure of labor demand, Burtless 
indicates. Demand for less skilled 
workers could have decreased due to 
collapsing demand for the goods or ser- 
vices produced by industries in which 
less skilled labor is concentrated. Un- 
skilled workers displaced by this shift 
would have been pushed to seek em- 
ployment in other industries, forcing 
down the wages paid to unskilled labor 
in those industries. Changes in the tech- 
nology of production may have de- 
press^ the demand for less skilled labor 
in selected industries or across industries. 

Or the decline in average wages re- 
ceived by unskilled workers could be 
due to sharp employment losses in in- 
dustries such as mining and durable 
manufacturing that normally paid high 
wages to less skilled workers. Fewer 
unskilled workers will be employed in 
high-wage industries. And by directing 
displaced workers into low-paying in- 
dustries, the average wage received by 
low-skilled workers in those low-wage 
industries could be depressed. 

Changes in the labor supply, accord- 
ing to Burtless, can have tw'o kinds of ef- 
fects on the wage structure. An increase 
in the number of less skilled workers will 
raise the proportion of all workers who 
receive low wages. Increased competition 
for less skilled jobs may depress wages 
relative to those received in more skilled 
occupations. Both of these effects have, 
in fact, occurred. Some of the differences 
between men and women may reflect sex 
segregation in the labor market and dif- 
ferent trends in labor demands If moder- 
ately-paid men are concentrated in de- 
clining industries, Burtless points out, 
“middle-class jobs could be disappearing 
for men even as the distribution of wages 
among women remains virtually un- 
changed.*’ 

Major Patterns 

Meanwhile, the pattern of employ- 
ment gains and losses emerging in sta- 
tistical analyses generally confirms the 
proposition that the number of jobs in 
better-paid industries has declined rel- 



ative to the number in the worst-paid 
trade and service sectors. Between 1967 
and 1977 this pattern was similar for men 
and women. From 1977 through 1987, 
the loss of goods-producingjobs contin- 
ued, but was more rapid for men than for 
female workers. This may explain, in 
part, the diverging patterns of wage gain 
for men and women. 

The declining importance of labor 
unions may be another contributor to 
the patterns observed in the data. 

Unions assist workers in raising the 
earnings of moderately-paid workers 
and frequently reduce wage inequality. 
Also, the erosion of the value of the 
minimum wage has affected the relative 
earnings of people at the lower tail of 
the wage distribution. 

Bmtless says a striking trend in the 
wage structure in recent years is the 
continuing and pronounced drop in 
earnings among less educated men. In 
an era in which an increased proportion 
of the workforce has some schooling 
beyond high school, workers who have 
had no more than a high school educa- 
tion appear to face growing handicaps 
in the labor market. This is due, Burt- 
less reports, both to shifts in labor de- 
mand and in labor supply. The most 
important factors in increasing wage 
differentials between less skilled and 
more skilled workers appear to be: 

• Changes in industrial structure. 

• Declining rates of unionization. 

■ The fact that the number of college- 
educated young men entering the 
workforce failed to keep pace with 
the rising demand for highly educat- 
ed workers. 

Some economists have proposed 
that the rise in part-time employment in 
the U.S., and the effect of government 
income maintenance has contributed to 
wage inequality. However, Burtless re- 
ports that the research does not support 
this contention. 

Burtless’ Conclusions 

The evidence from research is quite 
persuasive, Burtless believes, on sever- 
al points: 

■ Wage inequality has risen among 
men, but not among women. 



a It is extremely unlikely that part- 
time jobs or welfare state programs 
have contributed to changes in the 
wage structure. 

« The direct and indirect effects of 
supply-side demographic trends 
have contributed in a significant 
way to wage developments. 

® The long-term trend toward higher 
joblessness, particularly among 
prime-aged men, has contributed, to 
some extent, to earnings inequality. 

■j Changes in the industrial structure and 
the decline in unionization have con- 
tributed importantly to inequality. The 
deteriorating quality of American 
schools has left a generation of work- 
ers poorly prepared to deal with the 
challenges of modem employment. 

■ The changing structure of demand 
for skilled and unskilled male work- 
ers within industries has contributed 
to inequality. 

Burtless concludes that if the de- 
mand for unskilled labor has dropped, 
the obvious policy response is to im- 
prove the qualifications of the less 
skilled to match the developing re- 
quirements of the job market. “If the 
nation has too many unskilled workers, 
rather than too many bad jobs,” says 
Burtless,” both efficiency and equity 
will be served by improving the skills 
of workers now lodged at the bottom.” 

A Commentary on the 
Brookings Books 

These two books are useful compan- 
ion pieces in gaining a better under- 
standing of the trade-offs between eco- 
nomic efficiency and equity. Clearly 
there are substantial differences in the 
perspectives of different economists, in 
terms of theories, the assumptions driv- 
ing those theories, the interoretation of 
research findings, and strat to re- 
solve efficiency and equity problems. 
The phenomenon of dislocation is 
caught in this web of information. The 
data on reemployment wage rates for 
increasing numbers of dislocated 
workers, which typically involve a de- 
pression of their previous wages, must 
be figured into these analyses and the 
patterns emerging from them. 
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Understanding the 
Context of 
Dislocation 

The purpose of this short article is to 
encourage you to read ftirther in the lit- 
erature on restructuring and disloca- 
tion. Four books worth the effort are 
the following: 

■ Technology and Global Industry: 
Companies and Nations in the 
World Economy, edited by Bruce R. 
Guile and Harvey Brooks and pub- 
lished in 1987 by the National Acad- 
emy Press. 

a Technology and Employment: Inno- 
vation and Growth in the US, Econ- 
omy, edited by Richard M. Cyert 
and David D. Mowery, also pub- 
lished by the National Academy 
Press in 1987. 

m Innovation and the Productivity Cri- 
sis, by Martin Nei! Baily and Alok 
K. Chakrabarti and published by 
The Brookings Institution in 1988. 

■ Economic Restructuring and Emerg- 
ing Patterns of Industrial Relatiom, 
edited by Stephen R. Sleigh and 
published by the W.E. Upjohn Insti- 
tute for Employment Research in 
1993. 

Themes and Recommendations 

We merely provide glimpses of the 
wealth of information and insights in 
these books, as an incentive to readers 
to look for more. 

Economic Restructuring and 
Emerging Patterns of 
Industrial Relations 

The Sleigh book was based on a 
year-long series of seminars sponsored 
by the City University of New York, 
ending in a major national conference 
in 1990. The purpose of the book was 
to summarize and comment on innova- 
tive economic rcstructuring/o/n/Zy un- 
dertaken by corporations, unions and 
government. Sleigh says that the eco- 
nomic shocks of technological change 
and global competition created funda- 
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mental changes in economic systems 
in the past two decades. Dislocation has 
been a major legacy, requiring new 
roles for workers, management, labor 
and government in economic develop- 
ment — and a coherent economic re- 
structuring strategy. 

The book examines three main is- 
sues: 1) the extent to which work orga- 
nization and market share, or competi- 
tive position, are influenced by 
technical innovation; 2) how these 
changes are conditioned by government 
policies, and 3) what role collective 
bargaining relationships between 
unions and companies play in the eco- 
nomic restructuring process. A series 
of case studies of cooperative restruc- 
turing efforts, both in Europe and the 
U.S., are used to extract lessons for 
American policymakers. 

A number of themes permeate the 
book. An interest in team-based work 
organization is one, emphasizing the 
participation of workers in areas tradi- 
tionally reserved for managerial deci- 
sionmaking. Interfirm linkages is an- 
other interest — among companies, 
their suppliers, and their clients. Locat- 
ing the development of industrial poli- 
cies at the subnational or regional level 
is another emphasis, encouraging a mu- 
tually-reinforcing network of key ac- 
tors. 

And these are some of the lessons: 

M In the absence of a national industri- 
al policy, the efforts of state govern- 
ments have created a common direc- 
tion that supports an economic 
restructuring process integrating so- 
cial goal-setting while retaining the 
efficiency of market competition. 

■ Governments cannot influence eco- 
nomic development positively with- 
out sponsoring joint efforts among 
business, workers and unions. 

■ Transnational economic alliances 
and investment have blurred the na- 
tional identity of corporations and 
made it more difficult to develop a 
national industrial policy. 

■ A national industrial policy needs to 
be developed, however, based on a 
synthesis of what has been learned 



about collaborative restructuring ef- 
forts — that is, from the transnation- 
al borrowing and adaptation of 
ideas. 

The essays in the book identify both 
the challenges and the opportunities 
that exist in developing alliances that 
can have economic value. The authors 
seem to agree that die best role for the 
federal government is to facilitate and 
coordinate activities at the regional, 
state and local level, and provide an in- 
formation clearinghouse on best prac- 
tices. The most important conclusion 
seems to be that without some kind of 
institutional base for supporting eco- 
nomic restructuring, short-term politi- 
cal pressures will overwhelm the long- 
er-term needs of industrial economies. 

Technology and Employment 

The Cyert book grew out of the 
Committee on Science, Engineering 
and Public Policy of the National 
Academy of Engineering, prompted by 
the Committee’s interest in the impact 
of technological change on employ- 
ment opportunities, productivity and 
life quality. The theme is that employ- 
ment losses due to a decline in interna- 
tional competitiveness are likely to be 
grearer than any that result from tech- 
nologiu?! change, and that such change 
is essential to the preservation and ex- 
pansion of U.S. employment and wag- 
es. 

The book contributes a significant 
array of policy options and recommen- 
dations in three areas: public policies 
to assist worker adjustment to techno- 
logical change; public policies to sup- 
port the development and application 
of advanced technologies; and im- 
provements in private sector manageri- 
al expertise in evaluating and imple- 
menting new technologies. 

With respect to worker adjustment, 
the recommendations deal mainly with 
changes in Title III of JTPA, particular- 
ly to broaden the range of employment 
services, including job counseling, 
skills diagnosis, job search assistance, 
and placement services. There is strong 
support for increasing funds for basic 
and job-related skills, and for expand- 
ing income support during retraining. 
Instituting a program of federally-pro- 
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vided direct loans and loan guarantees 
administered by states or local areas is 
felt to be a critical resource for retrain- 
ing or relocation. Also recommended is 
a series of demonstration projects to 
test program designs, which are rigor- 
ously evaluated. 

innovation and the 

Productivity Crlais 

This Brookings book is one in a se- 
ries of publications on productivity is- 
sues. Funded in part by the National 
Science Foundation, it suggests that the 
sloty pace of innovation may be influ- 
ential in slowing productivity growth. 
Unlike some other economists, the au- 
thors propose that the size of the col- 
lapse of productivity growth in the U.S. 
should deflne this as a national crisis. 
They claim that had the growth in out- 
put per hour after 1965 equaled the av- 
erage rate from 1870 to 1965, output 
would have been more than 20% higher 
in 1985 than it actually was. Unless 
there is an increase in productivity 
growth, they say, Americans will suffer 
stagnant or falling living standards. 

In addition to labor productivity, 
two other indices of production perfor- 
mance are given attention: output per 
unit of capital used, and multi-factor 
production. The owners of capital did 
poorly after 1965. And the collapse of 
multi-factor productivity growth, in the 
aggregate, has been startling, with no 
^ clear message that it will increase. The 
^ authors place this in context by refer- 
ring to Ae data on other industrialized 
countries, which reveal a similar and 
sometimes more severe slowdown. 

Although the authors focus on the 
role of innovation, they find that infla- 
tion, recessions, oil price fluctuations, 
and other economic interferences in the 
1970s also affected economic perfor- 
mance. They suggest that there are two 
kinds of strategies for utilizing technol- 
ogy for economic growth: one expands 
the technological frontier, developing 
leading-edge industries (characteristic 
of the U.S.); the other diffuses technol- 
ogy that has already been developed (as 
in Europe). The Japanese are now using 
both strategies. 



Referring to an OECD study, how- 
ever, the authors propose that diffusing 
and refining already-developed tech- 
nology is the key to high productivity 
growth.They therefore argue for con- 
tinued support of basic science, for 
“middle-ground” and commercial re- 
search, and an improved educational 
system that appreciates the knowledge 
and skills required for technological 
innovation. There are important mes- 
sages here for workforce development. 

Technology and 
Global Industry 

Brooks and Guile begin the book by 
identifying two characteristics of global 
economic change: 1) the U.S. no long- 
er dominates world economic affairs 
but rather is only one element, even 
though significant, is an increasingly 
global economy, and 2) the growth of 
other national economies has permitted 
production and distribution to become 
increasingly transnational. Technologi- 
cal advances have played an important 
role in emerging economic and techno- 
logical integration, increasing the ca- 
pacity^ of transnational systems that car- 
ry information, goods and people. 

Focusing on the activities of multi- 
national companies and the policies of 
industrialized nations, the book seeks 
to answer these questions: 

■ What are the effects of changing 
technologies on the production and 
distribution of goods and services in 
the global economy? 

a How do technological advances con- 
tribute to shifts in the relative com- 
petitive advantage of nations, re- 
gions and firms? 

■ How do govenunents and enterpris- 
es respond to tlie dynamics of tech- 
nological advance in a global econo- 
my? 

■ What are the likely consequences of 
their efforts? 

Although the book directs our atten- 
tion to the management side of eco- 
nomic issues, there are keen insights to 
be culled for workforce preparation and 
dislocation between the lines. 



Worker Dislocation: 
A Review Article 

Ernst W. Stramsdorfer 

D6|Mriin«nt of Economlcii 
Wathlngton State Ulnlvenrity 



“You should learn a trade. They can 
never take that away from you.” 

— Anonymous factory worker, 
in advice to his son. 

As the above quote suggests, work- 
ing men and women are in fear of los- 
ing their jobs due to economic change, 
whether it be from technological inno- 
vation, foreign competition, shifts in 
demand, government regulation, or oth- 
er sources. There are epic tales of 
highly skilled workers attempting to 
outdistance technological change 
through increased effort and other 
means, with the demise of the glass 
bottle blowers at the turn of the centi\ry 
coming to mind most sharply. There 
are tales of violent resistance — ^the ac- 
tion of workers themselves creating 
evocative new words for our lan- 
guage — sabotage and Luddites. There 
is the modem image of the “Rust 
Bowl”, characterizing the upper indus- 
trial Midwest. 

Scientific interest in the impact of 
economic change on worker displace- 
ment began early in this century, fol- 
lowed by seminal articles by Haber 
(1925) and Myers (1929) in the 1920s. 
Case study monographs of worker ad- 
justment to plant shutdown began oc- 
curring in significant numbers soon af- 
ter the end of World War II, but 
systematic empirical research on the 
problem of worker displacement did 
not begin until the 1960s in response to 
waves of restructuring that began in the 
post World War II era to hit auto manu- 
facturing, meat packing, the railroads, 
coal mining, and ovher industries (See 
Borus, 1964; Schultz and Weber, 1966; 
Somers, 1968). Even then, the issues 
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were not fully understood, whether one 
was concerned with the measurement 
of the displacement loss to the individ- 
ual and society; the time and money 
costs of finding new employment; is- 
sues of social compensation to losers 
from change; whom to train in new 
skills, how to train them, and what 
skills to train; or, how to provide reli- 
able data to inform social policy on any 
of these issues. 

The three volumes discussed in this 
essay carefliUy and thoroughly assem- 
ble much of the methods of aiialysis 
and knowledge that we possess today 
concerning the above issues. The Costs 
of Worker Dislocationhy Jacobson, 
LaLonde and Sullivan (1993) provides 
one of the most conceptually compre- 
hensive and empirically complete stud- 
ies of the pattern and quantity of wage 
loss due to economic change and dislo- 
cation. Duane Leigh’^s study, Ay-sw/wg 
Displaced Workers, is a comprehensive 
review as of 1989 of the policies de- 
signed to ease the burden to workers of 
economic change and presents tine most 
recent evidence as to their relative ef- 
fectiveness. Back to Work, by Howard 
Bloom, reports with thorough method- 
ological detail on one of the very few 
classical random tests of programs de- 
signed to aid displaced and disadvan- 
taged workers. These studies progress 
from the most to the least general, aiid 
are discussed in that order. 

Reasons for Concern 

Policy makers and analysts are inter- 
ested in who gets damaged by econom- 
ic change, what the time pattern of eco- 
nomic loss is, and what the total 
present value of that loss is. A key rea- 
son for this interest is to determine 
whether to intervene in the economy 
and assist the dislocated. The decision 
to intervene is in part a function of the 
total eambgs lost per dislocated work- 
er and the distribution of that loss 
across groups in the labor force. Sec- 
ond, if society wishes to compensate 
the losers to any economic change, it 
needs to know who the losers are and 
how much they have lost. 

After extensive Congressional hear- 
ings in the late 1950s, the Area Rede- 



velopment Act of 1959 became the first 
national legislation to provide for inter- 
vention in the worker readjisstment pro- 
cess, Tliis legislation focused on poli- 
cies to aid in the economic adjustment 
process. No direct cash compensation^ 
for loss of human capital was contem- 
plated. The first effort at direct cash 
compensation for displacement came 
with the trade adjustment assistance 
program in the Trade Expansion Act of 
1962. Compensation was to be paid to 
those v/orkers damaged by liberalized 
international trade. The intent was, in 
part, to reduce political resistance to re- 
duction in trade restrictions; however, 
the program concept had strong theo- 
retical support in the compensation 
principle of theoretical welfare eco- 
nomics. Trade adjustment assistance 
has gone through several modifica- 
tions — tivst by simplifying eligibility 
for compensation in 1974 and then hav- 
ing eligibility and payments tightened 
up in 1981. 

As pointed out by Leigh, a major 
problem with this legislation is the dif- 
ficulty of identifying who the losers are 
from liberalized international trade (or 
any other structural charge to tlie econ- 
omy) and how much they lose. Current 
policy is now summarized in the Eco- 
nomic Dislocation and Worker Adjust- 
ment Assistance Act of 1988 (Lei^, 
pp. 93-94). This latest revision v/as 
motivated by evidence that prime age 
males were having difficulty adjusting 
to economic dislocation (Jacobson et 
al.). During fiscal year 1991 the federal 
government spent nearly one billion 
dollars to help displaced workers under 
this act. 

Yet, to anticipate what is to come, 
very little is known about the broad 
outcomes of various forms of labor 
market inter/entions to aid displaced 
workers other than Job search assis* 
tance. As Leigh’s thorough review of 
the literature shows, even less is known 
about the fine detail of optimal pro- 
gram design for different types and 
mixes of treatments relative to their tar- 
get populations. It is difficult to com- 
prehend this long-standing tolerance of 
partial knowledge and outright igno- 
rance of tliese policy outcomes. Yet, 
such tolerance exists, even with recent 



cash flows to the program of one bil- 
lion dollars a year and historical expen- 
ditures since 1959 that exceed many 
tens of billions in current dollars! 

The Dimension of the Problem 

Perhaps part of the historical reason 
for this tolei*ance has been our failure 
until recently to comprehend the full 
dimension of the problem. The studies 
by Leigh and Jacobson et al. indicate 
that the numbers affected are large and 
the losses per worker are severe. 
Working with different data sets and 
slightly different assumptions, both 
Leigh and Jacobson et al. estimate sim- 
ilar annual totals of workers hit by dis- 
location. A key assumption in such es- 
timates is to specify a minimum length 
of employment in a firm in order for a 
laid off worker to be counted as a dislo- 
cated worker. For one estimate, Leigh 
sets a minimum of at least five years of 
employment at a firm prior to disloca- 
tion. This assumption yields a total for 
displaced workers of 3.2 million a year 
over the time period 1979 to 1984. For 
the period 1980 to 1986, assuming a six 
year mirdmum job tenure, the estimate 
of Jacobson et al. is 2.6 million. Tak- 
ing the midpoint of this range gives an 
estimate of approximately two per cent 
of the economy’s labor force each 
year — more than 20% in ten years — 
damaged by dislocation. 

Leigh's estimate is that the typical 
displaced worker loses about 20% of 
his or her pre-dispiacement wages. 
More conceptually sophisticated analy- 
sis using longitudinal data that incorpo- 
rates a comparison group suggests that 
the initial annual loss is closer to 40% 
(Jacobson et al.). Moreover, the aver- 
age total present value of losses 
amounts to about $80,000. This is a 
private loss to the individual but it is 
also a real loss of economic welfare to 
society as well. As Jacobson et al. 
point out "dispkiceme7i( is a major set- 
back for experienced workers . " 

Using the Jacobson et al. estimates, 
the total annual cost of displacement to 
society is a present value of S208 bil- 
lion (2.6 million workers a year times 
$80,000 per worker). What if these es- 
timates arc four times too large? Tiie 
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loss is still $52 billion a year! Hopeful- 
ly, the economic changes that cause 
this dislocation provide society as a 
whole with benefits that equal or ex- 
ceed the losses. However, ignoring 
Food Stamps and other transfer pay- 
ments, the direct compensation that is 
paid by society’s beneficiaries to this 
change is only about a billion dollars a 
year, as noted above. 

Why Such Losses Occur 

The above estimates are large and 
dramatic. What is their source? Con- 
ceptually, does the total sum represent 
a potentially compensable loss? Jacob- 
son et al. draw a careful taxonomy of 
the source of these losses. Wage pre- 
mia can derive from the following 
sources or combination of sources: 

1. Some workers gain wage premia due 
to a collective bargaining agree- 
ment. 

2. Some workers may have firm-, in- 
dustry-, or occupation-specific hu- 
man capital. 

3 . Some firms may offer higher wages 
and be able to select higher produc- 
tivity workers as a result in certain 
situations. 

4. Some firms and certain sectors of 
the labor market employ promotion 
practices that preclude lateral entry. 

Leigh suggests that wage premia due 
to collective bargaining agreements 
may not represent a component that 
justifies compensation. However, there 
is evidence that unionized workers 
work more intensely and are more pro- 
ductive than similar non-unionized 
workers and that, in response to higher 
unit wage costs, firms will also select 
more productive workers as a result. 

To the extent tliat this is true, then 
union wage premia lost due to disloca- 
tion are compensable. Real productivi- 
ty has been destroyed, not just union- 
induced wage rents. In sum, if any of 
the four conditions are negatively af- 
fected due to displacement, both short 
tenn and long term losses can result. 



Policies to Mitigate 
Warnings Loss 

With the possible exception of some 
of the wage premiums due to unioniza- 
tion, unanticipated* economic disloca- 
tion that reduces or eliminates any of 
the four sources of wage premia above 
result in a loss of human capital or situ- 
ational productivity. This in turn is 
translated into a loss of earnings power. 
These losses of productive capacity can 
be seen as property right losses, and, 
hence, compensation is justified {some 
would say required) on the grounds 
that no one be made worse off by a giv- 
en economic change and at least one 
person be made better off. The point is 
that for society to benefit, there must be 
a net gain after all compensation for 
costs is accomplished. 

Leigh presents a complete taxonomy 
and critique of the policies that are in- 
tended to replace lost earnings power 
due to dislocation. He makes the point 
that while the most widely publicized 
group of displaced workers come from 
unionized, high wage jobs in the manu- 
facturing sector, in fact displaced work- 
ers overall are a very diverse group, 
differing by gender, ethnic origin, in- 
dustry, occupation and labor market lo- 
cation. These characteristics imply dif- 
ferent types and mixes of policies for 
each subgroup of displaced worker 
(Leigh). 

While he focuses on program poli- 
cies that have been implemented and 
evaluated in the several states, the fol- 
lowing program policies represent the 
full range of alternatives in today’s pol- 
icy toolkit: 

1. Formal classroom occupational 

training, with remedial or adult basic 

education where also needed. 

2. On-the-job training, with direct or 

indirect wage subsidies, including 



^There is a strong theoretical argument that 
only displacement losses due to unanticipated 
economic change be compensated. One can ar- 
gue that where change is predictable the market 
will provide a compensating wage differentia) in 
the fonn of a wage premium to balance out the 
expected capital loss. See Hamermesh, Cordcs 
and Goldfarb, 1987. 
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vouchers, to encourage firms to hire 
displaced workers. 

3. Job search assistance programs, in- 
cluding the components of: out- 
reach; orientation; assessment and 
testing; job search work shops; 
counseling; and job development 
and job matching. 

4. Advance notice and on site delivery 
of services. 

5. Economic alternatives to plant shut- 
downs, including: subsidies of vari- 
ous kinds to employers; assistance to 
enable employee buyouts of firms; 
and subsidies to workers to start up 
their own enterprises. 

The first four policies are intended to 
aid the transition of dislocated workers 
to new jobs and replace lost human 
capital. The final group of policies rep- 
resent efforts at direct job creation. 

The evidence as to the relative effec- 
tiveness of each of these policy choices 
is limited to say the least; however, 
there is better evidence on some initia- 
tives than on others. 

Occupational Training 

Occupational training programs pro- 
vided at the state level include a variety 
of innovative components, including 
vouchers; active participation of em- 
ployers to design training, choose train- 
ees, and hire the trained workers; per- 
formance-based contracts; and the 
diversion of unemployment insurance 
funds to pay for training. Leigh points 
out that the net impacts of these pro- 
grams largely have to be inferred from 
evidence based on evaluation of federal 
programs since the state initiatives gen- 
erally have not built in evaluation com- 
ponents that incorporate comparison 
groups. An exception to this is the 
Texas initiatives discussed by Bloom. 

There is now evidence with strong 
internal validity based on the National 
JTPA Evaluation conducted by Abt As- 
sociates Inc. in cooperation with the 
Manpower Development Research Cor- 
poration that retraining has a positive 
return for adult men and adult women. 
Sixteen Service Delivery Area (SDA) 
sites were judgmentally chosen with 
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random assignment to treatment and 
control within each site. As with the 
sites evaluated by Bloom, adult women 
fared better than men. OAer , non-ex- 
perimental evaluations of training re- 
ported by Leigh, such as the Dovmriver 
Community Conference Economic Re- 
adjustment Program, are too method- 
ologically flawed to allow any defini- 
tive judgment as to program outcomes 
(Leigh). 

Bloom’s (1990) evaluation of three 
Texas sites providing reemployment 
services for displaced and disadvan- 
taged workers demonstrates conclu- 
sively that with tlie appropriate politi- 
cal will and careful attention to 
experimental design and execution of 
that design in an on-going program, it 
is possible to properly evaluate such in- 
itiatives. His exhaustive account and 
record of design, program and evalua- 
tion management, and analysis provide 
a blueprint for federal and state legisla- 
tors who wiFh to discover whether pub- 
lic investments of this type are effec- 
tive. We agree with his statement that 
the Texas evaluation “...demonstrated 
the feasibility of conducting a high- 
quality, randomized field experiment at 
several sites simultaneously, within a 
modest budget and limited time frame” 
(Bloom). 

Of course, the problem at the federal 
level is not one ofinducing an individ- 
ual program site to agree to an experi- 
mental evaluation. The Natioml JTPA 
Evaluation has demonstrated this. The 
problem at the federal level is to mar- 
shall the political focus and energy to 
bring about nationally representative 
experimental evaluations within the 
context of on-going programs. Given 
the billions of dollars that have been 
?pent delivering subsidized employ- 
ment and training programs since the 
Area Redevelopment Act was initiated 
36 years ago, it is not unreasonable to 
expect such an initiative. 

Job Search Assistance 

As Leigh carefully points out, it is 
difficult to identify initially which 
workers laid off due to economic 
change have suffered losses of human 
capital. This being the case, it is rea- 



O 




sonable to stage the process of provid- 
ing reemployment services in order to 
gain the most effective use of social re- 
sources. The notion is to present all 
workers with Job search assistance 
first, withholding initially any wage 
subsidy, training voucher or other 
training services. Workers with fewer 
disabilities due to the dislocation will 
be able to find jobs first. This strategy 
was followed in the Downriver project 
mentioned above and positive returns 
to job placement seivices were identi- 
fied, within the (severe) methodological 
limitations of that analysis. Leigh reports 
that in general job search assistance ser- 
vices appear to pay off socially. 

Related to job search assistance is 
the reemployment bonus mitia, Ve 
wherein a cash bonus is paid to workers 
to induce them to search more diligent- 
ly for work. Experimental results for 
Illinois suggest such a policy does 
work, but non-experimental results in 
New Jersey suggest otherwise. The 
weight of the evidence should go to the 
experimental results, at this time, con- 
ditional on new evidence developing. 

Advance Notice 

Early intervention in the job reloca- 
tion process makes intuitive sense. 
Workers are helped thereby to maintain 
their self-esteem and job search ener- 
gies, and firms can be induced to coop- 
erate in any job development and re- 
training efforts more effectively. These 
concepts are incorporated in the Work- 
er Adjustment and Retraining Notifica- 
tion Act of 1988. Leigh points out that 
early notice does appear to reduce the 
private costs of adjustment to workers, 
largely due to the fact that some work- 
ers quit before the plant closing as a re- 
sult of locating a new job prior to sev- 
erance from the threatened job. 

However, it is possible that advance 
notice can disrupt the production effi- 
ciency of a firm in a variety of ways, so 
that gains to workers are then offset by 
losses to stockholders. Plausible argu- 
ments in the evaluation literature exist 
as to both positive and negative effects 
on worker productivity and firm costs 
due to advance notice. However, the 
weight of evidence suggests gains to 










workers and no necessary costs to em- 
ployers. Thus, advance notice appears 
to be a useful social policy. 



Job Preservation through 
Subsidies and Employee 
Buyouts 

How appropriate are policy inter- 
ventions designed to keep threatened 
firms operating? Leigh discusses three 
alternatives: 

1. “Assistance to allow current owners 
to keep operating or to attract new 
owners from outside the firm. 

2. Assistance to encourage employee 
buyouts of existing facilities. 

3. Assistance to enable displaced 
workers to start up their own small 
businesses.” 

Evidence on all these initiatives is 
limited to a few qualitative studies. 

The first initiative is generally sub- 
sumed under programs to establish “en- 
terprise zones.” The notion is to stimu- 
late economic development by 
reducing government regulation and 
lowering taxes in the zones. The ap- 
parent reality of state enterprise zones, 
tliough, is that total but not marginal 
tax rates are reduced, and the apparent 
benefits of increased government activ- 
ity within the zones are reduced by the 
cost of complying to regulations in or- 
der to receive any assistance. 

The second strategy relies for its ef- 
ficacy on the increased productivity in- 
duced in workers who now own the 
firm. For a variety of reasons, such a 
consistent successful result has yet to 
be established in practice. And, there is 
the further downside that the workers 
typically have taken their diverse port- 
folio of retirement investments and 
converted its capital value to a single 
egg in a single basket — their threatened 
firm. Such an action simply is not pru- 
dent, especially if the original owners 
are not willing to maintain a significant 
stake in the firm. 

The third strategy has several prob- 
lems with it. First, if the new business- 
es would have started up anyway, 
which has to be a possibility, those re- 
ceiving the subsidy get a windfall gain. 
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No net social benefit results. Second, 
since such a start-up firm would be 
subsidized, it would have lower costs 
and could conceivably displace an ex- 
isting, otherwise efficient, firm or 
firms. 

As to the third point, few additional 
jobs may be generated and, indeed, in- 
ducing inexperienced individuals to at- 
tempt to be entrepreneurs may just ex- 
acerbate failure. 

An Overall Judgment 

Convincing and detailed evidence 
DOW exists on the extent and severity of 
earnings loss due to economic changes 
of all types. The social costs are very 
large indeed and warrant a systematic 
development and valid testing of poli- 
cies to deal with the problem. 

The survey by Leigh reveals a very 
rich and diverse set of f>olicy options, 
only the highlights of which are pre- 
sented in this survey. But the fact is 
that but for a few of the policies, we 
know little of their efficacy. Job 
search assistance should be the core 
readjustment policy. It is relatively low 
cost and avoids the problem of having 
to distinguish truly displaced workers 
from those unemployed due to season- 
al, cyclical or short term frictiopal 
causes. The role of retraining isf less 
clear. It seems clear that employers in 
local labor markets must be involved in 
the training process. Training should 
be offered only for well specified needs 
and in the types and quantities of work- 
ers needed. Apparently, more remedial 



education should be offered, yet states 
have sli^ted this initiative in favor of 
economic development activities. Fi- 
nally, there simply is not enough evi- 
dence at this time to offer such subsi- 
dies to firms in an effort to maintain or 
increase jobs. And workers who can 
succeed in difficult entrepreneurial en- 
deavors are least likely to need the ser- 
vices tendered to truly dislocated work- 
ers. 

As a concluding point, given the 
very large real losses to workers as well 
as the large amount of public resources 
devoted to assisting these workers, it is 
reasonable to expect more systematic 
evaluation of program effects, which 
includes more use of experimental de- 
sign, but at the very least, the use of 
state-of-the-art quasi-expcrimental de- 
sign. 
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In a comprehensive paper on dislo- 
cation by Robert W. Bednarzlk, a senior 
economist at the U.S. Department of 
Labor, and Malcom Lovell, Director of 
the Labor Management Institute at 
George Washington University, the au- 
thors discuss the problem of dislocation 
and its major causes, and review na- 
tional projects seeking to reduce this 
emerging characteristic of postlndustrial 
societies. 

Written for the Competitiveness Poli- 
cy Council in 1992, the paper provides 
an excellent summary of expert opinion 
and research regarding dislocation Is- 
sues In the 1980s, and the programs 
developed to address those issues in 
the U.S. and Europe. The authors place 
retraining and reemployment strategies 
in the context of the need to make sub- 
stantial Improvements in the quality of 
the American workforce to remain inter- 
nationally competitive. 

They locate the beginning of adjust- 
ment assistance programs In the area 
of public transportation. The govern- 
ment had concluded in the aftermath of 
consolidating certain transportation sys- 
tems that workers losing jobs in the 
public sector should be compensated 
by receiving assistance in finding new 
ones. Similarly, changes causing job 
loss in the area of trade were followed 
by the Trade Adjustment Assistance 
program (TAA). 

The surge In unemployment in the 
eai1y 1 980s related to unprecedented 



numbers of plant closures and mass 
layoffs increased concern about dislo- 
cation. In 1982, Title ill of JTPA re- 
sponded to that concern. And states 
began to finance their own retraining 
programs for dislocated workers. Title 
111 was followed by the Economic Dislo- 
cation and Worker Adjustment Assis- 
tance Act (EDWAA). which was to in- 
crease the E&T system’s provision of 
assistance to the dislocated. 

There was reason to worry about 
dislocation, the authors contend. From 
1985 to 1989, 4.3 million workers had 
become dislocated. Most were in man- 
ufacturing, but dislocation was spilling 
over into the service sector. EDWAA 
and TAA were serving about 1 50,000 
dislocated workers a year out of over 
800,000. In 1986. the Secreta^ cf La- 
bor's Task Force on Worker Dislocation 
took a serious look at the problem 
again, as well as the programs devel- 
oped to resolve it. Not surprisingly, they 
found that the workers at highest risk of 
dislocation were those in high risk in- 
dustries — operators, fabricators and 
laborers In mining, construction and 
manufacturing. Minorities and youth 
were at particular risk, Bednarzik and 
Lovell point out, because of their con- 
centration In import-sensitive industries. 
These workers experienced severe 
structural barriers to reemployment. 

Later in the 1980s we began to see 
middle managers and other white collar 
workers in the ranks of the dislocated. 
Public policymakers began to ask 
themselves If EDWAA and TAA were 



adequate, sufficient responses. 

The authors discuss a variety of pro- 
grams and pilot projects spawned by 
anxiety over Increasing dislocation. 
Five'demonstration projects had been 
undertaken under Title 111 over an eight- 
year period beginning in 1 980. All were 
evaluated. Bednarzik and Lovell's sum- 
mary of the results for OJT and class- 
room training In the five projects shows 
a mixture of success and failure for the 
same Interventions in different projects. 
A consistent finding, however, was ^at 
training, per se, did improve the earn- 
ings of dislocated workers over time, 
and job search assistance seemed to 
improve both employment and earn- 
ings. 

A study of ten exemplary dislocated 
worker projects under Title 111 provided 
Important insights about service strate- 
gies and service delivery processes, to 
which the authors give appropriate at- 
tention. But by 1989 EDWAA had re- 
placed Title III, emphasizing “rapid re- 
sponse,” labor-management 
cooperation, a more powerful role for 
substate areas, linkages with Ul, the 
Employment Sen/ice and TAA, and 
longer-term retraining. There the paper 
ends, and our series of articies on na- 
tional evaluations begins. The well-con- 
ceived and Implemented studies re- 
viewed in these articles tell us much 
about an ongoing national dislocated 
worker program, EDWAA, about ED- 
WAA demonstration projects, and about 
DOL studies of self-employment. 



Evaluating 
Dislocated Worker 
Programs: U.S, 
Department of Labor 
Studies in the 1990s 

In the 1990s, the issue of worker 
displacement and dislocation became a 
more serious concern, growing more 
problematic with increasing economic 
competition and risk. Title III of JTPA 
was created to respond to this fluoresc- 
ing phenomenon in postindustrial life. 



JTPA was accompanied by formal gov- 
ernment interest in performance man- 
agement and evaluation, likely related 
in part to the decentralization and 
privatization of employment and train- 
ing programs to states and local areas. 
Among other purposes, federal moni- 
toring and evaluation guidelines and 
standards were to compensate for this 
devolution of power by maintaining 
quality, consistency and equity. They 
v/ere to assure that a transfer of authori- 
ty and administration to states would 
not result in a redirection of programs 
toward state-specific agendas and away 
from Congressional intent. 



One result was the conducting of 
some of the most sophisticated and sci- 
entifically viable evaluations of ongo- 
ing and demonstration programs in the 
employment and training field that had 
ever been undertaken. Most of the pro- 
grams and projects evaluated have fo- 
cused on the economically disadvan- 
taged. However, in the 1990s tlie U.S. 
Department of Labor (DOL) launched a 
number of evaluations of Title III pro- 
grams and demonstrations, as well as 
pilot tests of new strategies addressing 
dislocation. 

Historically, dislocated workers 
were a new target group for services, * 
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encompassing workers of all socio-eco- 
nomic levels who were experiencing 
permanent job loss in the occupations, 
industries and businesses that had sus- 
tained them over time. Employment 
and training policymakers, planners 
and program designers faced a new 
challenge. And evaluations now began 
to investigate the nature and effects of 
programs responsive to the middle 
class. 

The Status of Evaluation 
Research 

This article briefly reviews a subset 
of the DOL-funded evaluations of pro- 
grams for dislocated workers. The 
1990s witnessed increased government 
commitment to the use of experimental 
research designs for estimating the ef- 
fectiveness (return on investment) of 
ongoing programs and demonstration 
projects. At the same time there was 
new support for learning more about 
the influence of organizational struc- 
tures, functions and processes in pro- 
grams, and service delivery characteris- 
tics, on the outcomes of these programs 
— that is, a growing interest in process 
evaluations, or studies of program im- 
plementation. 

Where possible, the DOL encour- 
aged a “methodological partnership” 
between process and net impact evalua- 
tions when studying programs, which 
permitted evaluators to offer better ex- 
planations of the potential causes of 
program outcomes. The process and net 
impact evaluations of the WA State 
SEED program are an example, as are 
the twin process/net impact evaluations 
of the Trade Adjustment Assistance 
program. In other cases, process evalu- 
ations preceded potential outcome stud- 
ies, or were considered most appropri- 
ate when the focus was mainly on 
implementation issues. 

Figure 1 provides a quick overview 
of the kinds of evaluations conducted 
by DOL on dislocated worker pro- 
grams, the major reseach questions for 
which answers were souglit, and the 
methodologies used. 

The Results of the Studies 

DOL’s process studies emphasized 
similar aspects of programs: their orga- 
nizational dimensions and their service 



delivery systems. All but one of the 
outcome studies utilized either random 
assignment to produce equivalent treat- 
ed and control groups, or a constructed 
comparison group of individuals con- 
sidered similar to those receiving pro- 
gram services. 

There is no question that measure- 
ment is a special challenge in process 
studies. Many of the variables describ- 
ing program implementation that are 
likely to exert the greatest influence on 
program outcomes are difficult to mea- 
sure. The variability in these measures 
across process evaluations reduces 
one’s ability to compare studies. 

The measurement of outcomes has 
been limited traditionally to a small set 
of easily quantifiable employment and 
earnings variables, to which measures 
have been added to provide informa- 
tion on interim outcomes such as the 
completion of educational and skill 
competencies, and longer-term out- 
comes such as job retention. 

However, even these standard out- 
come variables are not always defined 
identically. And less tangible and more 
inclusive sets of outcomes for individu- 
als, such as an increase in work motiva- 
tion and productivity, greater self-es- 
teem in the workplace, or less stress in 
one’s family life, are rarely given atten- 
tion, even though these outcomes may 
be highly significant. 

Conceptualization differences also 
reduce the ( ^mparability of evalua- 
tions, even uough studies may be fo- 
cused on similar issues and target 
groups. The underlying assumptions 
evaluators make in defining and fram- 
ing the research, and the paradigms 
(propositions) that flow from these as- 
sumptions subtly influence the con- 
struction of research questions. 

These caveats should be kept in 
mind when looking across the conclu- 
sions and recommendations of evalua- 
tors regarding these programs for dislo- 
cated workers. 

The Evaluation of the Trade 
Adjustment Assistance 
Program (TAA) 

Although our concern about the dis- 
located in the 1990s has been more dra- 
matic than in earlier periods, the federal 



government has been sensitive to dis- 
placement due to trade conditions as 
early as the 1930s. The Trade Expan- 
sion Act of 1962 began the recent his- 
tory of compensating workers for trade- 
induced job loss thorough “trade 
adjustment assistance.” Although the 
TAA program put in motion by this 
legislation was reduced drastically in 
the 1980s, legislation in 1986 reempha- 
sized adjustment services, 1988 legisla- 
tion expanded the use of training to 
speed readjustment, and reemployment 
services were subsequently given more 
attention. With the advent of EDWAA 
in 1988, coordination between TAA 
and the new program was mandated. 
This linked TAA with a more disci- 
plined and sophisticated service deliv- 
ery system. Clearly the legislative evo- 
lution of TAA reflected the growth in 
the population of dislocated workers in 
this society. 

The Process Evaluation 

of TAA 

The purpose of the evaluation was to 
learn more about 1) the certification, 
notification and application processes, 
and 2) the delivery of reemployment 
services. Conclusions and recommen- 
dations are presented in Figure 2. 

The Evaluations of the 
Implementation of EDWAA 

The design of EDW^-iA programs 
was dependent largely on the planning 
preferences and expertise of the states. 
Consequently it was important for DOL 
to know, from a public policy stand- 
point, what designs seemed most ap- 
propriate to the needs of dislocated 
workers and what configurations ap- 
peared to produce the outcomes intend- 
ed by the Congress. Conclusions from 
the EDWAA evaluation are presented 
in Figure 3 and recommendations are 
presented in Figure 4. 

The Phase II report on EDWAA im- 
plementation was reviewed in an earlier 
issue of Evaluation Forum and so is 
not given detailed attention in this arti- 
cle. The methodology of the evaluation 
is quite unique. The research was guid- 
ed by an innovative, thoughtful and 
useful model describing the elements of 
“a responsive service deliveiy system” 
for dislocated workers. Information 
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The St Louis Motropolitan Re Employment Projoct An Impact Evalu- 
ation. Research and Evaluation Report Series, Employment and 
Training Administration, 1993. 




Type / Design 


Main Research Questions 


Methods 


Net impact 
evaluation / 
quasi-experimenta! 
design 


What are the net impacts of the services re- 
ceived by participants on their earnings, receipt 
of Ul, and their reemployment over time? 


Data Collection 
m Ul wage record data 
B Telephone interviews 
B Program records 






Data Analysis 

B Treated group was compared with random- 
ly-selected sample of St. Louis residents fil- 
ing for Ui. 


Evaluation of the Trade Adjustment Assistance Progratn: Pr^ss 
Report Office of Strategic Pianning and Policy Development, 
Employment and Training Administration, 1992. 




Type / Desian 


Main Research Questions 


Methods 


Process evaluation / 
Descriptive design 


■ What is the nature of services provided? 

a To what extent did 1988 amendments im- 
prove program? 

■ What were “best practices" in terms of 
service delivery? 

B How does TAA Interact with other dislocated 
worker programs? 


Data Collection 

m Aggregate quarterly quantitative data on 
payment and service activity under each pe- 
tition. 

m Unstructured on-sIte Interviews with central 
office staff and some local staff. 

■ Participant survey. 

Data Analysis 

B Comparison of delivery of services over 
time, among states, by petitions. 


Pniill fk 
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/nfernef/ona/ Trade and Worker Dislocation: Evaluation of the Trade 
Adjustment Assistance Program. Office of Strategic Planning and 
Policy Development, Employment and Training Administration, 1993. 




Type / Desian 


Main Research Questions 


Methods 


Net impact 
evaluation / 
quasi-experfmental 
design 


> What are the differences in the characteris- 
tics of TAA caseloads and other dislocated 
workers? 

■ What kinds of services were provided by 
comparison with participants in other pro- 
grams? 

m What effect did TAA services have on the re- 
employment experiences of TAA participants, 
as compared with other dislocated workers? 

« What effects did the 1988 amendments and 
changes In Title 111 have on TAA? 


Data Collection 

■ Participant survey 

• Telephone interviews with random sample 
of recipients 

■ Labor market data 

Data Analysis 

■ Comparison of client characteristics, servic- 
es received, and dient outcomes for TAA 
treatment group with matched comparison 
group of Ul daimants. 
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Study of the ImpSemontathn of the Economic Dislocation and Worker 
Adjustment Assistance Act. Research and Evaluation Repoit Series, 
Employment and Training Administration, 1 992. 



Typa/ Design 



Main Rosaarch Questions 



Methods 



Process evaluation/ 
descriptive design 



What is the nature of EDWAA polices and 
organizational practices? 

What are the operational links t>etween 
1) state and substate functions and 2) de- 
sign and delivery of services? 



DaUii Collection 
B Telephone interviews 
■ Site visits: discussions and interviews with 
state, substate, and service providers 

Data Analysis 

a Cross-site analysis of qualitative and quantita- 
tive data from program MIS and other sources. 






Study of the impiementation of the Economic Dislocation and Worker 
Adjustment Assistance Act: Phase U, Responsiveness of Services. 
Research and Evaluation Report Series, Employment and Training 
Administration, 1993. 



Type / Design 



Main Research Questions 



Methods 



Process evaluation / 
descriptive design 



What types of services are provided? 

To what extent do these services respond to 
clients’ needs? 

What are “best practices” regarding program 
designs and service practices? 

What problems are occurring re: service de- 
livery policies and practices? 



Data Collecdon 

m Site visits. 

■ Discussion with state-level staff. 

■ Interviews with substate staff. 

■ On-site observation by evaluation team. 

■ Discussion with participants. 

B Review of client files. 

Data Analysis 

m Comparison of collected information with an 
evaluator-constructed ideal-type “Conceptu- 
al Model of Responsive Dislocated Worker 
Services” to judge extent to which programs 
fit this model. 






' 

Study of the Implementation of EDWAA: Report on the Survey of Substato 
Areas. Research and Evaluation Report Series, Employment and Training 
Administration, 1993. 



Type / Peaign 



Main Research Questions 



Methods 



Process evaluation/ 
descriptive design 



What is the nature of the organization and 
operation re: EDWAA services such as type 
of clients targeted, characteristics of services 
provided and their possible effects on out- 
comes? 

What is the orientation of programs and ex- 
tent to which they are consistent with the 
themes of their legislation, and what Is the 
possible effect on outcomes? 

To what extent is EDWAA coordinated wi.Ui 
Title IIA of JTPA, with what effects? 

What Is the probable effect on outcomes of 
the level of responsivenesc "o client needs? 



Data Collection 

m Worker Adjustment Annual Program Report: 
for types of clients served, recency of layoff, 
educationaS level, previous wage level, barri- 
ers to employment, program outcomes. 

m Survey data. 

■ Review of state p!an<^. 

■ Labor market information. 

Data Analysis 

m Survey results and other data were analyzed 
against the conceptual framework of proposi- 
tions regarding ways substate areas organized 
their programs, the types of clients served, the 
types of responsiveness to needs, and the out- 
comes achieved, using statistical methods. 
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Demonstration. Research and Evaluatidh Report 
Series, Employment and Training Administration, 1994. 



Type / Design Main Research Questions 



Methods 



Process evaluation / 
descriptive design 



How effective are Community Devaiopment 
Corporations in expanding employment oppor- 
tunities for dislocated workers through linkages 
between entrepreneurlai training and other eco- 
nomic development activities? 



Data Collection 

B Site visits. 

B Interviews with staff from 1 1 substate pro- 
grams in eight states. 

a Interviews with state-level EDWAA staff in 
five states. 

B Conferences. 

a Telephone interviews. 

Data Analysis 

« Anaiysis of an array of quantitative and 
qualitative informador.. 



Stephen _ 

Serving Dislocat^ Farmers: An Evaluation of the EDWAA Farmers and Ranchers Demonstrations. Research 
and Evaluation Report Series, Employment and Training Administration, 1994. 

Type / Design Main Research Questions Me tho ds 



Process/outcome • How effective are the service categories used 
evaluation, descrip- in the demonstration? 
ttvs design 






Data Collection 
e DOLWAPRdata. 
m On-site interviews and discussions. 

Data Analysis 

u Services received compared with those re- 
ceived by other EDWAA participants, 
s Relationship analyzed between services and 
participants’ short- and long-term outcomes. 



fehdhei^Wh9>t.{ed^.ij,;^MliS^ 

Self-Employment Pri^rams for Unemployed Workers. Parts 1-4. Unemployment Insurance Occasional Papers 
Employment and Training Administration, 1992,* 

Type / Design Mait» Reaeareh Questions Method* 



Process evaluation/ 
descriptive design 



How viable is self-employment as reemploy- 
ment option for the unemployed? 

What Is the relationship between 1) early pro- 
vision of business assistance services and 
self-employment allowances to Ui claimants, 
and 2) successful outcomes in self-employ- 
ment? 



Net impact evalua- 
tion/experlmentai 
design; cost/benefit 
study 



How effective are SEED services in terms of 
self-employment and earnings? 



*1, From Unomphyed to SolFEmployod , StaphBn W«ndn»r «nd Jon M#»»*nBBr; 

2. Wtfhington Sotf-Employmont Entorprlso Davolopmont (SEED) Domoo$tratlon, Ttiry Johnwn 
■nd JanloB Uonard; 3, UtMMchutattt Unomphymotd Inturance Setf'Emphyment Domonatn- 
lion, J«o»b B«nu*. MtchBlta Wood. Chd* N*pl*r«l«, end Tony Johnton: 4, SoU-Emptoymant 
Progmma for tho Untmployad: An Analyala ol Program Evaluation and OporaVona flaaaareh In 
Europe and North Amarloa, Douplat Swtt. 



Data Collection 

e Quantitative data on diants and services via 
DOL’s Participant Tracking System. 

a On-site discussions and interviews with 
SEED personnel using standard protocols, 
via monitoring visits. 

■ On-sftegAxip interviews With SEED paiSdparits. 

a On-site observation by evaluation team. 

Data Analysis 

a Cross-site analysis of quantitative/qualitative 
data on organizational an'angements, service 
delivery. 

Data Collection 

a Ul wage records; telephone survey. 

Data Analysis 

m The self-employment and earnings out- 
comes of SEED participants (offered busi- 
ness start-up training, a waiver of the Ul 
work requirements, and periodic payments 
equal to Ul benefits) were compared with a 
control group that received only Ul payments 
and services. 
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about EDWAA implementation was 
then judged against this model. The 
major conclusion was that tiiere was 
substantial variation across the study 
sites in the level of responsiveness of 
EDWAA to the needs of this target 
group. Areas experiencing higl; levels 
of dislocation, and special projects 
tended to be the most responsive. 

The third report in the series on ED- 
WAA was based on a survey of sub- 
state areas delivering EDWAA servic- 
es. It addresses both process and 
outcome issues. The results regarding 
service integation were particularly 
useful. Those substate areas with the 
greatest integration of services with 
JTPA IIA tended to have these charac- 
teristics: 

B They ser\^ed workers whose profiles 
were similar to the economically 
disadvantaged. 

■ They utilized OJT as the primary 
training option, but provided less re- 
sponsive services. 

m They provided weaker early inter- 
vention services. 

At this stage in EDWAA evolution, 
incentive/sanction systems were in 
place in several states, and the evalua- 
tion indicated that performance incen- 
tives appeared to increase substate ef- 
forts to obtain positive outcomes. Also, 
eight of the study states provided finan- 
cial incentives for providing long-term 
training, which had the effect of in- 
creasing the intensity of that training. 
The main recommendations based on 
the survey focused on developing re- 
sponsive services, organizing services 
more effectively, and improving state 
policies. These recommendations mir- 
rored many of those summarized in the 
revie\/ here of the first study. 

Evaluation of the EDWAA 
Farmers and Ranchers 
Demonstration 

A major demonstration project fo- 
cusing on rural dislocation, this pilot 
project involved four states. The evalu- 
ation was based on intensive site visits 
and produced insightful case studies. 

The demonstration was critical in 
that little has been known about the 






issue Area 

Certification of groups of workers and notification of workers about TAA 



Conclusions 

Most workers In certified groups did 
receive notices about TAA but states 
^Ticked a systematic approach to Iden- 
tifying and notifying potentially eligible 
workers. 



Recommendations 
■ States should obtain lists and con- 
tact workers who are laid off follow- 
ing certification, and ask firms to 
notify state agencies of subsequent 
layoffs, following up with employers 
to assure that this occurs, 
a States should use U1 wage record 
and other data as a basis for identi- 
fying potential eiiglbles. 
e States should disseminate informa- 
tion about TAA through brochures 
and the media. 



issue Area 
Application to TAA 

Conclusions 

Just as certification and notification 
were occurring earlier In workers' 
spells of unemployment, so the appli- 
cation process had been moved for- 
ward. 



Recommendations 
* Group orientations to TAA would 
strengthen movement toward the 
use of TAA services. 



issue Area 

Delivery of Reemployment Services 
Conclusions 

Substantial numbers of TAA clients re- 
ceived long-term occupational training 
at a variety of public/private institu- 
tions. Nearly all dients received Em- 
ployment Service job search services. 
A small number received payments to 
finance job search outside local ar- 
eas, and some received relocation al- 
lowances. Clients rarely used avail- 
able remedial education or OJT. 

Some workers strongly resisted re- 
ceiving training. Staff sometimes 
lacked a detailed knowledge of labor 
market conditions and skill needs, and 
therefore were vulnerable to making 
inappropriate decisions about training 
options. 

Most states placed little emphasis on 
post-training placement services. 
Mandated coordination between TAA 
and EDWAA was working well al- 
though few sites actually Integrated 
service delivery. 



Recommendations 

■ Staff needs to assist workers In 
viewing reemployment options more 
realistically. 

« Employment Service staff should 
become more informed about local/ 
regional employment opportunities 
and appropriate training. 

■ TAA programs should work more 
closely with unions. 

■ States should offer placement ser- 
vices as well as job search servic- 
es. 

■ States should consider consolidat- 
ing TAA and EDWAA. 
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issue Area ■ Smplementirf Jer) Problems 
Funds were underused given the extent of the needs, and 
the services were received by only a small proportion of dis- 
located workers. Job search assistance and short-term train- 
ing were overemphasized and rapid response capacity was 
often weak. The requirement for matching funds had unir^- 
tended effects on the type of services provided and the kind 
of workers served. 

Issue Area a EDWAA Resource Use 
Most states selected Service Delivery Areas (SDAs) as the 
organizations to receive substate EDWAA funds. States 
la^ed adequate data for allocating funds — that Is, data on 
plant closings and mass layoffs, declining industries, and 
farmer/rancher economic hardship. Only half the states felt 
resource allocation was consistent with the needs of the dis- 
located. 

Issue Area ■ Targeting 

While most states used inclusive definitions of eligibility, tar- 
geting priorities and methods varied considerably across 
states. 

Issue Area b Service Delivery Systems 
Most states supported the federal guidelines regarding ex- 
penditure of 50% of funds on retraining, but few states en- 
couraged substate areas to request waivers for training or to 
reward the provision of long-term training. 

Issue Area b Local Program Organization and Design 
Some local areas partially integrated EDWAA with Title IIA 
service systems. Half of substate areas had focused on laid- 
off workers, one-third on the long-term unemployed. The ex- 
tent of dislocation had directed these priorities. Most sub- 
state areas complied with the federal emphasis on retrain- 
ing; about half (those with high levels of dislocation) had 
emphasized long-term training. 

However, some administrators felt this emphasis denied the 
importance of basic readjustment services, and led to an 
overuse of OJT. Over half of the local areas emphasized 
classroom training; however, about one-third emphasized 
OJT. Most offered only limited supportive services. Even 
fewer provided needs-related payments. Most states en- 
couraged participation by labor and management but only a 
third had created formal labor-management committees. 

Issue Area « Coordination with TAA, ES and Ul 
Most states had nonfinanciai agreements with ES and Ul, 
usually negotiated at the local level. Nearly two-thirds of 
states provided EDWAA 40% funds to ES/UI for rapid re- 
sponse activities. 

Issue Area « Coordination with Economic Development 
Coordination tended to be limited to Information sharing re: 
potential and actual layoffs. A few states used 40% funds for 
special coordination activities. Even so, companies' layoff 
plans were frequently too far In advance of WARN notices to 
allow for effective layoff prevention efforts. 



Economic dovelopmeril funds were sometimes used to re- 
train workers to stave off layoffs but not to serve already-dis- 
located workers. Sometimes EDWAA funds were used to 
support economic development projects. 

Issue Area a Coordination with Other Programs 
Coordination occurred mainly through joint efforts to deliver 
services, particularly training. Sometimes EDWAA and feder- 
al vocational education funds, or EDWAA and federal firuan- 
cial aid funds were used together. Title IIA programs and ED- 
WAA were frequently co-located administratively. Linkages 
with other human service agencies were considered weaker, 
such as with welfare agencies. 

issue Area ■ Basic Readjustment Services 
Pre-layoff services, rapid response and basic readjustment 
services were often coordinated by a single agency. Some 
substate areas did not provide basic readjustment services if 
dislocated workers were not receiving training. Local areas 
were struggling to develop appropriate assessment strate- 
gies for this target group. Only one-third of the substate ar- 
eas were using a case management system. 

Classroom training was often perceived by dislocated work- 
ers as offering better reemployment opportunities than OJT. 
However, classroom training was highly localized and diver- 
sified. Community and technical colleges were the most com- 
mon providers. OJT positions had mixed benefits, sometimes 
more oriented to economic development goals than to the 
needs of workers. Few training options Involved workplace- 
based learning. 

Issue Area ■ State Role 

Jhe requirement that EDWAA funding be passed through 
states to substate areas tended to weaken the state's leader- 
ship role In setting program parameters and assuring ac- 
countability. In retaining 40% funds, however, states frag- 
mented the EDWAA delivery system, leading to ; o!icy confu- 
sion and a lack of policy coordination. 

Issue Area ■ Program Accountability 
Most states did not provide much technical assistance to 
substate areas. Reviews of reports to determine compliance 
with regulations focused on procedural rather than program- 
matic issues. All states had fiscal expenditure reporting sys- 
tems to insure compliance with federal fiscal rules, but states 
v/ere not consistent in recapturing funds from delinquent 
SDAs. 

States tended to retain a strong role in designing and admin- 
istering 40% activities, budgeting for a variety of activities. 
Over half used these funds to contract for specific services to 
dislocated workers statewide. 

In terms of programmatic accountability, EDWAA perfor- 
mance standards had little meaning, since no incentive or 
sanction system had been developed by states. Few had 
even developed criteria for reviewing and approving substate 
plans, 
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Figure 4V'« . EDWAA Evaluation Rec^ 



a Substate capacity building should 
be supported. 

9 Resource management practices 
should be Improved. 

Rapid response must be assured. 

M Labor and management should join 
government in the design and im- 
plementation of service delivery, 
n A coordinated use of program and 
other resources should be encour- 
aged. 

The coverage of the program 
should be extended. 

Longer-term retraining and reem- 
ployment plans should be included 
in service options. 

EDWAA administrators and service 
providers should concentrate on the 



needs of tins target group, despite the 
dramatic decline in American farms 
over the 1 980s. Ten percent of the na- 
tion's farms had disappeared within a 
few years. Historically, urbanization 
and the consolidation of farming activi- 
ties had led to a loss of more than four 
million farms over the past sixty years. 
But the farm crisis of the 1980s was ex- 
ceptional in tljat the movement out of 
agriculture in this decade was no longer 
mainly voluntary. This unprecedented 
dislocation was having severe effects 
on agriculture-dependent commimities. 
The demonstration was to identify the 
employment and training needs of this 
group of workers and determine how 
best to meet them. 

Tl\e main findings of the evaluation of 
the demonstration were these: 

■ Participants tended to be in severe 
financial distress despite high levels 
of education and off-farm jobs. 

■ Recruitment goals were met despite 
the reluctance of farmers to partici- 
pate in employment and training 
programs. 

■ Outreach efforts appeared to in- 
crease enrollment. 

■ Over 80% of the participants re- 
ceived retraining. 




design of rapid rc^sponse, on realiz- 
ing the benefits of reduced labor/ 
management tensions, and on Im- 
proving the range and availability of 
services that are responsive to dis- 
located workers' needs. 

m States need to create a more coor- 
dinated statewide program, linking 
rapid response, recruitment, and 
early Intervention services, and co- 
ordinating plant-specific projects 
with ongoing local service systems 
to produce a more seamless deliv- 
ery of services. 

m States need to improve efforts to 
identify the needs of dislocated 
workers and tailor services to those 
needs, sharing "best practices mod- 
els” with other states. 



tt The four projects varied greatly in 
the way funds were used and in the 
average cost per client. 

■ Half of all participants were still 
fanning three months after program 
termination; two-thirds were en- 
gaged in off-farm employment, 
many having had this kind of em- 
ployment prior to program participa- 
tion. 

■ Participation appeared to increase 
employment rates, hours worked and 
hourly wages, but only modestly — 
and there was no evidence that any 
project was any more effective than 
another in delivering services or in 
the outcomes. 

■ Case management systems seemed 
well-suited to this group, and re- 
training appeared to be as appropri- 
ate for this group as for other dislo- 
cated workers. 

Commentary 

The evaluations of EDWAA reveal 
the substantial variation across states 
and across substate areas in the way na- 
tional programs may be implemented. 
Since EDWAA funding policy gave 
greatest authority and discretion to sub- 
state areas, it was more difficult in this 



program than in other decentralized na- 
tional E&T programs to respond to na- 
tional guidelines intended to maintain 
the program’s consistency, comparabil- 
ity and accountability nation-vride. 
\^le EDWAA’s funding and organi- 
zational framework ailov/ed more ex- 
perimentation, this experimentation did 
not always translate to progress in deal- 
ing with dislocation. 

The current renewed interest in fed- 
eral block grants consolidating federal- 
ly-sponsored E&T programs, and the 
accompanying emphasis on states’ and 
local level rights in the human services, 
has not yet benefited from a serious 
consideration of consistency, compara- 
bility and accountability issues sur- 
rounding this proposal. It is possible 
that in attempting to resolve the issue 
of duplication and program prolifera- 
tion in the federal system, we may un- 
wittingly produce a new form of human 
service system fragmentation at subna- 
tional levels. Under the block grant 
policy suggested as of the writing of 
this article, states, substate areas and lo- 
cal communities will be encouraged to 
design and implement their own ver- 
sions of an E&T system, assisted only 
by very general federal policy and 
oversight guidelines. This is likely to 
result in programs whose operation and 
results cannot be compared appropri- 
ately with those of others, thus denying 
the Congress the basis for improving 
national E&T policies. 

Meanwhile, there are important les- 
sons from the EDWAA evaluations. 

We suggest a few: 

H Programs focused on dislocated 
workers must be unusually sophisti- 
cated and professional in their re- 
cruitment and selection process. 

a They should try to intervene prior to 
or immediately after layoffs. 

■ They should provide a wide range of 
income support and service options. 

■ They should construct individual 
service plans with clients that are 
based on competent client profiling, 
on a thorough knowledge of avail- 
able education, training and related 



Evaluation Forum t Issue 11 • Summor 1995 



36 






Features ■ National Studiea of Dtekx^ted Worker Programs 



services and how to access them, on 
the most up-to-date and comprehen- 
sive labor market information avail- 
able, on the key results of research 
on dislocation, and on clients’ own 
strong preferences for assistance. 

■ They should have vigorous case 
management systems to provide on- 
going support to clients as they take 
advantage of the program’s services 
and benefits. 

These suggestions require a highly 
trained staff with access to critical data- 
bases, service networks, and other 
sources of information relevant to the 
functions required of them. They must 
be able to invest employers and unions 
in becoming an integral part of the de- 
sign and implementation of these pro- 
grams. They need to be generally fa- 
miliar with the characteristics of 
evaluation research so that they are 
competent consumers and contractors 
of research on their own programs. 

With regard to service options in 
dislocated worker programs, the DOL 
monograph A Guide to Well-Developed 
Services for Dislocated Workers is a 
veritable gold mine. This guide was in- 
tended for EDWAA practitioners at all 
levels of government. Information for 
the guide was obtained from 70 sub- 
state areas and 10 special projects in 24 
states, and focuses on the design, orga- 
nization and provision of services to 
dislocated workers between Program 
Years 1989 through 1992. The mono- 
graph provides detailed information on 
the following service options: 

■ Early intervention services. 

■ Services to help clients develop ap- 
propriate reemployment plans. 

■ Basic readjustment services. 

■ Retraining services. 

Although this extensive guide was 
designed for program operators, it is an 
excellent resource for policymakers, 
planners, oversight personnel, and eval- 
uators. 



■H 

Other National-Levei 
Studies In the 1980s 
and Early 1990s 
Relevant to 
Dislocation 

The problem of dislocation is, his- 
torically speaking, a recent one. The in- 
crease in international economic com- 
petition and rapid changes in 
technology have led to unprecedented 
business and industrial restructuring 
with long-term effects for workers. Lit- 
erally hundreds of analyses and evalua- 
tions related to the issue of worker dis- 
placement/dislocation due both to 
ordinary business cycles and to restruc- 
turing have been sponsored over the 
past decade, testifying to the serious- 
ness and importance of this phenome- 
non in all postindustrial economies. 

This article alerts us to a few of these 
studies and reports. 

Selected U.S. General 
Accounting Office (GAO) Studies 

A series of studies relevant to dislo- 
cation was commissioned by the U.S. 
Congress between the late 1980s and 
the present. Figure 1 provides a brief 
overview of their purposes and results, 
and the GAO’s main recommendations. 

Selected Studies in the 1980s 

Stephen Baldwin’s report. Technol- 
ogy and Employment Policy, commis- 
sioned by the National Commission for 
Employment Policy in 1987, was a 
careful expose of the effects of techno- 
logical change on jobs and workers. As 
a form of structural change, or restruc- 
turing, technology effects are manifest- 
ed, Baldwin demonstrated, in worker 
displacement, retraining, and organiza- 
tional changes internal to firms for the 
purpose of taking better advantage of 
new markets and production processes. 
The benefits of technological change, 
Baldwin pointed out, are not evenly 
distributed across workers, firms and 
communities. Therefore a major policy 
implication of such change is the need 
for effective training and retraining 
programs that provide workers with the 
skills needed to be productive in a dy- 



namic economy pressured by interna- 
tional competition. 

The Office of Technology Assess- 
ment of the U.S. Congress produced a 
revealing report in 1987 on one of the 
U.S. Department of Labor’s traditional 
programs for workers dislocated due to 
trade. Trade Adjustment Assistance: 

New Ideas for an Old Program, Re- 
viewed intensively in an earlier issue of 
Evaluation Forum, this report provided 
insights for revising the TAA program 
that contributed directly to later interest 
in consolidating TAA and EDWAA. 

The authors praised TAA’s conceptual 
design for its income-supported long- 
term training, and EDWAA’ s adminis- 
trative flexibility and broader coverage 
as well as its quicker and more compre- 
hensive service response, and suggest- 
ed that the best features of the two pro- 
grams be combined in a new one. 

Often overlooked, the report alerted 
policymakers to another aspect of TAA 
— it is virtually the sole federal program 
to provide sustained, intensive technical 
assistance to small and medium-sized 
manufacturers. Interestingly, the OTA re- 
port viewed the negative results of a pre- 
vious evaluation of TAA by DOL’s In- 
spector General’s Offree as a less than 
fair judgment of its overall effectiveness. 

Mathematica Policy Research pro- 
duced an informative report for the 
U.S. Department of Labor and the New 
Jersey Department of Labor v\ 1989, 
The New Jersey Unemployment Insur- 
ance Reemployment Demonstration 
Project. TTiis project examined the use 
of the UI system for identifying dis- 
placed workers early in their spell of 
unemployment, and the provision of 
early intervention services to speed re- 
employment. The net effects of three 
“treatments” were studied: l)job 
search assistance only; 2) job search as- 
sistance combined with training and re- 
location assistance; and 3) job search 
assistance combined with a cash bonus 
for early reemployment. All three strat- 
egies resulted in net benefits to both in- 
dividuals and the society at large. 

Selected Studies in the 1990s 

Another useful report by OTA was 
made available in 1990, Worker Train- 
ing: Competing in the New Iniemation- 
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Purpose end Type of Study 

Process study: to obtain information on services provided 
to dislocated workers by TAA and EDWAA In three states. 




Results 


Major Recommendations 


» TAA was serving a Sarger proportion of hard-to-p!ace 
workers than EDWAA. 

• TAA participants received more income support and 
were more likely to enter long-term training. 

■ Both programs provided classroom training and OJT, but 
EDWAA placed more emphasis on OJT. 

• Both programs lacked comprehensive Information on 
participant outcomes, but particularly TAA. 

■ There was only limited coordination between the two 
programs, partly due to complex TAA regulations. 


. « A better Information syster.^ for both programs should 
be developed, to enable poltoymakers to determine 
what services are received and what outcomes are 
achieved. 

• TAA and EDWAA should be consolidated and serve ail 
dislocated workers. Irrespective of the source of dislo- 
cation. 

D Income support should be provided with retraining. 

■ Early intervention Is essential. 

« A larger menu of assistance options should be avail- 
able. 
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Purpose and Type of Study 

Process study: to explore the implications of the TAA certi- 
fication (eligibility determination) process in a random sam- 
ple of petitions. 




Results 


Major Recommendations 


« Flaws were found In 63% of the petitions filed. Major 

flaws were: 

^ Incompleteness and inaccuracy of data collection from 
companies.. 

♦ Inadequacy of analyses of trade statistics. 

^ Inadequate customer surveys. 

* Variations In volume of petition filings related to level 
of outreach and assistance provided to workers wish- 
ing to file petitions. 


« Certification process should be made more accurate, 
and information more adequate for determining 
elgibility. 

0 States need to be more responsive to workers filing 
petitions. 

• TAA and EDWAA should be consolidated, and the need 
for certification eliminated. 






Purpose and Type of Study 

Process study; to Investigate how well the WARN system 
was working in 11 states. 




Results 


Major Recommendations 


B While workers were more likely to receive prior notice of 
closures and layoffs, nearly half of the employers with 
100+ workers were not required to give notice. 

• Some employers appeared to be confused about WARN 
provisions, even though DOL brochures and seminars 
sought to educate them. 

B Many employers believed WARN benefited dislocated 
workers In terms of their reemployment but decreased 
company productivity. 


a DOL should be given the responsibility and authority to 
vigorously enforce the WARN provisions. 


FIgura 1 continues 
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Purpose and Type of Study 

Outcome, study: testimony summarizing DOL studies, such 
as Inspector General’s and Mathematica's, and their impli- 
cations for policy. 



Results 



Mejor Recommendations 



* TAAwas not achieving its key goals: 

♦ Benefits not equally accessible. 

♦ Slow program response. 

♦ Services limited and not well tailored to needs. 

♦ Not enough counseling. 

« Waiver provision !od to only half of TAA recipients 
receiving training. 

♦ Limited job pfacement assistance after training. 

♦ Inadequate information system for determining perfor- 
mance. 

B Separate funding sources have led to separate rules/ 
regulations which act as barriers to quick, equitable, 
comprehensive service provisions. 



DlSiOcated workers need to be assisted systemsticsliy 
and consistently irrespective of the source of disioca- 
tlof! — i.e., whether dislocated uncJer TAA, EDVMA, De- 
fense Conversion/DlverEiticatlon, Clean Air, Transition 
Assistance Program, Demonstration Centers for Re- 
training Dislocated Workers, etc. 

Programs need to be consoiidated. 



Purpose and Type of Study 

Process study: to explore the implication* * of the new re- 
employment program Initiatives that specifically target dis- 
located workers (In an amendment to TAA considered a 
"bridging* program prior to iegisiation consolidating dislo- 
cated worker programs). 


Major Recommendations 


■ The program had many of TAA’s shortcomings. 


. Processes should be dsvelopsd that ©njiure that the 
certification process is quick and fair, 
e Activities in addition to clas”-room trainirg, such as job 
search assistance, should be allowable in considering 
eligibility for Income support. 




I^a/n/no P/wfframV (Decamber 1 993) ^ - •’ 


Purpose and Typs of Study 

Process/llmited outcome study: to learn more about the im- 
plementation and outcomes of assistance programs, relat- 
ed to the dislocation of timber workers .n notthsrn Califor- 
nia in the late 1 970s. 

Results 


Maior Recommendationc 


■ Many workers received wage replacement benefits or 
severance pay, but few received training. 

■ Service providers were reluctant to develop retraining 
programs. 

B Data on participant outcomes were not adequate enough 
to determine what happened to workers after receiving 
services. 

■ Data on outcomes for communities were not sufficient to 
sort out the effects of the programs. 


. Receipt of benefits shoiiid be closely tied to participa- 
tion in training. 

■ New job opportunities must be created in communities 
affected by major layoffs, in addition to providing re- 
training and income support. 
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Proces# study: to f«vi«w in four states DOL’s effort to 
snake (Ranges kt tfiis transitionel program (rrKKfeied on 
TM) So 1) shorten the certification process, 2) include 
steles k) that prosess, 3) broaden eiigibUity regulations, 

4) tie income support more doseiy with retraining, and 

5) eliminate wfiiivers. 



(5 DOL had attcceasfuliy addressed a number of sfiortcom- 
inga. 

a Secondary workers (those it^dir6<a^y affsctod by NAFTA) 
sfiil JftcecS probioms in accessing beneffis. 

* Scmse workers were still receiving incomplete assess- 
jnents and remedial assistance, and a limited mix of ser- 
vices. 

■ Performance rnsiiagement remained inadequate. 



Major Recommendations 



More consistent and comprehensive assistance should 
be assured to all eligible workers. 

A better performance monitoring system should be de- 
veloped for participants’ services and outcomes. 



a/ Economy. Also reviewed in more de- 
tail in an earlier issue of the journal, 
this OTA study examined sixteen op- 
tions for training policy regarding the 
needs of the economically disadvan- 
taged, displaced workers, workers with 
special needs, and the general popula- 
tion of employed workers. These op- 
tions were organized within four issue 
areas: 1) reducing barriers to company 
trainiag; 2) upgrading workers’ skills; 
3) providing training and technology 
assistarice; rmd 4) enhancuig the quality 
and effectiveness of training. The re- 
post thoroughly analyzed these options, 
referring to policy analyses and re- 
search conducted about them, and rec- 
ommended certain options for policy 
consideration. 

A study conducted in 1993 by the 
Congressional Budget Office examined 
lessons learned in obtaining informa- 
tion about the actual experiences of dis- 
located workers. The report, Displaced 
Workers: Trends in the 1980s and Im- 
plications for the Future, detailed the 
number, characteristics and experiences 
of a large sample of dislocated workers, 
and the implications of tliis information 
for federal policy. 

Another study in 1 993 that provided 
insights about dislocation was spon- 
sored by the American Management 
Association (AMA). AMA conducted a 
survey regarding workforce reductions, 
producing the 1993 AMA Survey on 
Downsizing and Assistance to Dis- 
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placed Workers for the association’s 
corporate members. The report indicat- 
ed the following: 

■ Forty-six percent of the firms sur- 
veyed reported downsizing within 
the past year. 

■ The cuts made by these firms in- 
creased to an average of 10.4% of 
their workforces. 

■ Sixty-six percent of the downsizing 
was due to companies’ concerns 
about future business downturns. 

For the first time, a majority of the 
jobs eliminated by firms in the survey 
iavolv^ supervisors, middle managers, 
professionals and, technicians. The 
number of firms offering outplacement 
services to dislocated workers was at a 
seven-year peak. The report confirmed 
that workforce reductions were occur- 
ring more frequently. Fewer than half 
of the companies downsizing had in- 
creased their profits or their worker 
productivity as a result. The larger 
companies were more likely to trim 
jobs than smaller ones, but small busi- 
nesses cut more deeply when they did 
downsize. Firms that had downsized 
since 1989 (70% of the survey sample!) 
were cautious about hiring new work- 
ers and had tended to lengthen hours 
and/or overtime as an alternative. Few- 
er tlian half of all the firms surveyed 
had increased their workforce since 
1988. Although the survoy was limited 



to firms that were members of AMA, 
the results were particularly useful 
since the study involved one of the few 
employer-based surveys conducted in 
the 1990s. 

The importance of an adequate and 
comprehensive occupational informa- 
tion system was emphasized in David 
Stevens’ 1993 monograph for the Na- 
tional Occupational Information Coor- 
dinating Committee, Occupational In- 
formation: The "Blue Highways” of 
the Labor Market. The paper pointed to 
the utility of occupational information 
in helping users become more dlsciimi- 
nating and skillful in selecting and 
translating published statistics to meet 
specific policy, planning, management 
and oversight needs, and in heightening 
users’ sensitivity to workplace changes 
they can see are occurring but about 
which they do not yet have confirming 
statistics. 

Some Comments on the Studies 

The recommendations in the reports 
referred to involve something of a con- 
sensus on the desirability of: 1) weld- 
ing income support to longer-term re- 
training, 2) providing a comprehensive 
set of service options, 3) consolidating 
programs so that all dislocated workers 
are eligible for a unified program, irre- 
spective of the source of their dislocation, 
and 4) increasing administrative flexibili- 
ty by removing regulatory barriers to ef- 
fective program implementation. 
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Self-Employment as 
an Employment 
Strategy for ^ 
Dislocated Workers 

The two major self-employment 
projects funded by EK)L in 1988, and 
reported on in 1992, in the monograph 
SelfEmployment Programs for Unem- 
ployed Workers, were targeted to UI 
claimants on permanent layoff. Howev- 
er, entrepreneurial self-employment 
strategies had been of major interest in 
Europe for some time, as an option for 
coping not only with cyclical unem- 
ployment and imderemployment but 
also with dislocation due to restructur- 
ing and downsizing of workforces. 

The Organization for Economic Co- 
operation and Development, for exam- 
ple, housed key experts on programs 
throughout Europe that were utilizing 
self-employment as an alternative to re- 
employment. OECD was also interested 
in ^e distinctive challenge this option 
involved for evaluators, sponsoring an 
international seminar on the evaluation 
of ‘‘Self-Employment and Employment 
Creation Schemes” in 1989. 

The DOL report was very useful in 
suggesting how experimental evalua- 
tions can benefit policymakers and pro- 
gram designers in developing success- 
ful self-employment programs. It also 
made an important contribution to the 
knowledge base regarding European 
entrepreneurial initiatives. 

Self-Employment Programs 
in Europe 

The DOL monograph distinguises 
between “microenterprise develop- 
ment,” which is used synonymously 
with “self-employment,” and “small 
business development,” which is im- 
portant to the definition of the enter- 
prise strategy DOL was testing and 
evaluating. Microenterprises were 
viewed as sole proprietorships with 
only one or a few employees. Small 
businesses were defined by the Small 
Business Administration as having less 
than 500 employees. The DOL report 
reminded us that microenterprises as 
well as small businesses were growing 
rapidly* But public policymakers at 
both the federal and state level had con^ 



centrated their attention on small busi- 
ness development as an economic de- 
velopment tool, largely to the neglect 
of nucroenterprise development. 

Rather than serving economic devel- 
opment needs, self-employment pro- 
grams in other industrial nations have 
been designed to expand employment 
opportunities. By the mid-1980s the 
seventeen advanced industrial countries 
who were members of OECD were of- 
fering formal self-employment pro- 
grams for the unemployed. According 
to the DOL report, by 1987 nearly 20% 
of new business development in Great 
Britain was due to self-employment; al- 
most 25% in France. 

At the time the DOL report was 
written two major self- employment 
models had been developed in Europe: 

■ The “French Model,” involving 
lump sum self-employment allow- 
ancs that were to provide part of the 
capital needed for a microenterprise. 

■ The “British Model,” involving peri- 
odic payments as a form of income 
support while developing and oper- 
ating a new microenterprise, such as 
UI in theU.S. 

Although tlie European effort was 
not rigorously evaluated, descriptive 
information was suggesting that self- 
employment was a significant option 
for the unemployed and dislocated. 

U*S. Approaches 

In 1985, DOL became interested in 
testing new strategies for dislocated 
workers, and using an experimental re- 
search design to evaluate their effec- 
tiveness. The major elements of these 
strategies were: 1) early identification 
and profiling of dislocated workers us- 
ing UI data, 2) referral of dislocated 
workers to providers of reemployment 
services, and 3) the linking of UI and 
reemployment services within a single 
seamless delivery system for these 
workers. The set of reemployment ser- 
vices of greatest interest wereyai 
search assistance, training, relocation 
assistance, reemployment bonuses, and 
self employment allowances paired 
with business support services. New 
Jersey was selected as the first test site. 
Later the Department funded two addi- 



tional Ul-related projects testing the 
use of reemployment bonuses as incen- 
tives for an early return to work for dis- 
located workers in Washington State 
and Pennsylvania. And in the late 
1980s DOL funded the St. Louis Met- 
ropolitan Reemployment Project, 
which was evaluated using a quasi-ex- 
perimental research design. 

In 1987, the Department funded a 
project to test self employment strate- 
gies, Washington State was selected as 
the test site. In the same year, however, 
the Omnibus Budget Reconciliation 
Act required the Secretary of Labor to 
test self-employment programs in a 
multi-year project Involving three 
states. In this second effort to test self- 
employment approaches, DOL, the four 
states, and the research contractor joint- 
ly designed the strategy to be tested and 
the evaluation plan. The design com- 
pleted in 1989 also drew heavily from 
insights gained in a study of self-em- 
ployment projects in Great Britain, 
France and Sweden, funded by the Ger- 
man Marshall Fund. Concerned about 
potential costs to states, two of the 
states withdrew from the project, leav- 
ing Washington and Massachusetts as 
the leading test sites. 

The Washington SEED Project 

The Washington project followed 
the French model (lump sum payments) 
while Massachusetts applied the British 
model (periodic payments). Both in- 
volved evaluations using an experimen- 
tal research design requiring the ran- 
dom assignment of a pool of UI 
claimants into a group receiving self- 
employment services and subsidies, 
and a control group not receiving them. 

In the Washington project, claimants 
interested in the project, and potentially 
subject to random assignment, were re- 
quired first to attend an orientation ses- 
sion as a first step in the application 
process. Of the 44,456 UI claimants in- 
vited to participate in the project, only 
7% attended the orientation. Of the 
group attending the orientation, 61% 
subsequently applied and were random- 
ly assigned. Consequently, the project 
was testing the self- employment strate- 
gy on a small, self-selected group of 
claimants. Although the evaluation of 
SEED was featured in an earlier issue 
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of Evaluation Forum, we repeat some 
of the main findings here, which were 
reported in detail in DOL's monograph, 
First Impact Analysis of theWashington 
State Self-Employment and Enterprise 
Development Demonstration. 

Program Implementation: The 
Process Study 

■ The dislocated workers in the study 
groups were older and more educat- 
ed than the larger imiverse of UI 
claimants, and more likely to have 
been in higher-wage white collar (oc- 
cupations. Many had an employed 
spouse and substantial assets. 

■ Clients achieving five interim out- 
comes received a lump-sum pay- 
ment equal to their remaining UI 
benefits. These outcomes were: 

1) completion of the training pro- 
gram, 2) development of an ap- 
proved business plan, 3) the estab- 
lishment of a business bank account, 
4) compliance with licensing re- 
quirements, and 5) the obtaining of 
adequate financing for their pro- 
posed business. 

■ The program treatments clients felt 
were most useful were business 
training, the waiver of the UI work 
search requirement, and the lump- 
sum payment. 

Program Results: The Net 
Impact Study 

« The project increased the likelihood 
of being self-employed by about six 
months, a bit more for women than 
for men. 

■ Both treatment and control groups 
started primarily service sector busi- 
nesses. 

■ Approximately a third of these busi- 
nesses failed in the first year, but the 
demonstration did not appear to af- 
fect this outcome. 

» Average gross monthly earnings from 
self-employment were increased by 
approximately $ 150/month. 

■ The demonstration reduced slightly 
the likelihood that clients would par- 
ticipate in wage/salary employment 



during the demonstration period, 
and reduced total earnings from this 
form of employment. 

9 Both gross business income and tax- 
es were significantly higher for the 
treatment group. 

K The treatment group worked fewer 
hours and obtained lower earnings 
in Ul-covered employment. 

» If self-employment and wage/salary 
employment were considered to- 
gether, the demonstration increased 
the likelihood of being employed 
and remaining employed, but had no 
significant effect on total earnings or 
average monthly earnings. 

n Although the demonstration reduced 
the length of UI payments, it in- 
creased the amount of total benefits 
when the lump sum payment is in- 
cluded. 

The evaluators also gave attention 
to job satisfaction and job creation for 
other workers. They found that the 
demonstration netted 49 new jobs for 
nonparticipants, although these went 
mainly to family members, and there 
was no effect on job satisfaction. 

The Massachusetts Project 

This self-employment demonstration 
followed the British model. Clients inter- 
ested in applying were required to attend 
a training seminar consisting of a series 
of training workshops and counseling 
sessions. An additional condition was 
that those receiving self-employment al- 
lowances would have to work full-time 
on microenterprise development. 

Only about 4% of the 26,170 UI 
claimants invited to attend the seminar 
did so. Of this number, 63% applied 
and were randomly assigned. Again the 
study group was small and self-selected. 
Although tine DOL monograph on self- 
ernployment projects was written prior to 
obtaining final Impact results, the evalua- 
tors did come to a few early conclusions: 

■ It is likely that self-employment is 
appropriate only for an estimated 
5% of UI claimants. 

■ Self-employment businesses will 
likely be in the service sector. 



« Participants interested in self-em- 
ployment will more likely be male, 
white, middle-aged and educated 
than most UI claimants, and from 
professional/technical/managerial 
occupations. Women, however, are 
likely to be overrepresented in this 
select group of claimants. 

The EDWAA Job Creation 
Demonstration 

With the decentralization of the bulk 
of EDWAA funding to Service Deliv- 
ery Areas or local community organiza- 
tions, the role of Community Develop- 
ment Corporations (CDCs) and other 
community-based nonprofits in deliver- 
ing services to dislocated workers be- 
came more important. DOL's multi- 
year Job Creation Demonstration was 
to study this role, and the evaluation 
was to judge its effectiveness. 

The emphasis in this project was on 
job creation through self-employment. 
These were the main results of the eval- 
uation: 

m Participants* characteristics varied 
considerably from one site to anoth- 
er, but overall they were older and 
better educated than the typical dis- 
located worker population. 

n The selection of applicants also var- 
ied greatly, ranging from selection 
strategies that involved sophisticated 
screening to self selection. The latter 
led to a high attrition rate; the 
former was quite successful. 

a Curriculum design using an “adult 
learning approach,” extensive staff 
and peer support, and substantial 
technical assistance to individuals 
appeared to be critical to success. 

B Staff qualifications that included 
practical business experience and a 
high degree of commitment were 
important. 

B Development of business plans was 
an essential component of training. 

B Lack of access to revolving loan 
funds and other sources of capital 
was the most serious barrier to 
achieving demonstration goals. 

B Strategies for designing services and 
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service delivery systems converged 
across sites over the course of the 
demonstration, but organizational 
problems interrupted services and 
led to inappropriate hiring decisions, 
poor communication with partici- 
pants, and reduced efficiency. 

■ Coordination with EDWAA was 
mixed, whereas the CDCs worked 
well with the UI system. However, 
the specter of UI sanctions affected 
data collection for the evaluation, 
since some participants did not re- 
port their previous self-employment 
experiences and understated their 
earnings from businesses begun as 
part of the demonstration. 

B In the short term, the demonstrations 
were successful in launching new 
businesses and creating secondary 
employment — 45% of participants 
started up businesses and 29% found . 
wage and salary employment. 

Among the businesses begun, 76% 
were still in operation a year later. 

■ Comparing the Job Creation Dem- 
onstration with the Washington 
State and Massachusetts UI demon- 
strations and five other projects sug- 
gested that the demonstration’s 
gross outcomes, such as business 
start-up and short-term survival 
rates, were on a par with other mi- 
croenterprise programs undertaken 
in the same general period. 

■ Service industries were the most 
prevalent type of start-up business- 
es, even though only 22% of the par- 
ticipants had been dislocated from 
this sector. 

m Comparing employment outcomes at 
follow-up with those of EDWAA 
substate areas indicated that the 
demonstration had not produced as 
beneficial employment outcomes as 
were characteristic of EDWAA. But 
when both placements in wage and 
salary jobs and business start-ups were 
considered, the six Job Creation sites 
had an average employment rate of 
74% compared to EDWAA* s 67%* 
The evaluators concluded that the ac- 
quisition of entrepreneurial training 



produced marketable skills even if 
they were not immediately applied to 
starting a business. 

■ Earnings from self-employment 
were generally disappointing. Earn- 
ings varied widely from business to 
business, and net business income 
averaged only about $ 1 000/month 
when measured at the six month fol- 
low-up and $582/month at the one- 
year follow-up. These self-employ- 
ment earnings were much lower than 
the $12 average hourly wage the par- 
ticipants had earned prior to layoff. 
Pre-post studies of gross incomes can 
be misleading. However, on average, 
it appears clear that dislocated workers 
tend tc earn less in their new jobs. 

*• The outcomes for demonstration 
participants who did not start busi- 
nesses of their own but rather sought 
reemployment were more positive, 
matching those of the more tradi- 
tional EDWAA programs in the 
same areas — 79% entered unsubsi- 
dized employment. 

The evaluators made a number of 
recommendations. If immediate wage 
replacement were to be a participant’s 
primary goal, they suggested that self- 
employment did not appear to be a fea- 
sible alternative in the short term. If 
participants and program sponsors were 
prepared to absorb a certain level of 
risk, microenterprise strategies were 
recommended as offering longer-term 
benefits. 

For a small subset of dislocated 
workers, who were aware of the risks 
and the effort required, were highly 
motivated and prepared to develop a 
specific business concept, self-employ- 
ment was recommended as a viable 
strategy. But even workers with these 
qualities needed access to capital as 
well as training to be successful, the 
evaluators concluded. Since a self-em- 
ployment strategy was distinctly differ- 
ent from a reemployment approach, the 
evaluators recommended that current 
performance management systems uti- 
lize a set of variables and measures 
more responsive to the uniqueness of 
microenterprise development, in judg- 
ing its outcomes. 



Self-Employment In Europe 

The section of the DOL monograph 
on self-emplo> ment directs our atten- 
tion to ‘‘European Experience with 
Self-Employment Programs,” by 
Stephen Wandner and colleagues. It 
provides a useful if brief overview of 
European strategies. Although these 
strategies have undergone policy 
changes with increasing unemployment 
and slimmer government human ser- 
vice budgets, it is important to review 
the strategies that characterized tlie late 
1980s. But we should notice that Cana- 
da and Australia have also been inter- 
ested in self-employment approaches. 

These were some of the characteris- 
tics of European self-employment pro- 
grams in 1988: 

a Their primary purpose was to pro- 
mote self-employment (microenter- 
prise development) among the un- 
employed, to contribute to solutions 
to unemployment, 

■ The target groups of these programs 
usually involved those eligible for 
income support payments through 
national unemployment insurance 
programs, but some included the 
long-term unemployed and those re- 
ceiving social welfare benefits. 

■ The services ordinarily included fi- 
nancial assistance and supportive 
services. The definition of “support- 
ive” was services designed to assist 
workers in planning, establishing 
and operating the businesses they 
were creating. Financial assistance 
was offered in 1) lump-sum pay- 
ments equal to all or part of the 
funds remaining in an individual’s 
insurance entitlement, which was to 
support initial capitalization of his 
or her business, or 2) periodic weekly 
or bi-weekly payments from the insur- 
ance system to give a worker continu- 
ing income in the early stages of plan- 
ning and operating a new business. 
The payments often lasted for a year. 

u A comprehensive package of servic- 
es included a number of business-re- 
lated services, although the ingredi- 
ents of the package varied greatly 
from country to country. These ser- 
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vices encouraged business counsel- 
ing, entrepreneurial training, techni- 
cal assistance, exemptions from 
certain business taxes and legal re- 
quirements, and preferential access 
to business loans and grants outside 
the programs. 

■ In some countries, microenterprise 
development was limited to certain 
economic sectors, and to special cat- 
egories of the imemployed. 

Based on selective gross outcome 
studies, both the French and British 
models appeared to have a positive ef- 
fect on employment and economic de- 
velopment Compared to the actual 
numbers of unemployed workers 
served by American demonstration 
projects, these programs enrolled laige 
numbers of the unemployed. In France, 
the Chomeurs Createurs program en- 
rolled 72,000 in 1986. The British En- 
terprise Allowance Scheme exceeded 
100,000 participants in 1987. However, 
the prediction of the evaluators study- 
ing the U.S. demonstrations was con- 
sistent with the French and British ex- 
perience, namely that under 5% of the 
unemployed were appropriate for self- 
employment programs. 

Increasing familiarity with self-em- 
ployment efforts in Europe led to sub- 
stantial transnational borrowing of self- 
employment concepts. Enough so that 
the National Governors’ Association 
and the Corporation for Enterprise De- 
velopment jointly sponsored a national 
conference on self-employment strate- 
gies in 1987. The conference brought 
experts from Europe, Canada and else- 
where to address self-employment is- 
sues at the time Americans were tour- 
ing European programs under the 
German Marshall Fund. The borrow- 
ing, however, was mainly by Ameri- 
cans from Europeans. 

Evaluating Self-Employment 
Programs in Europe 

The Appendix of the DOL mono- 
graph contains an interesting UI Occa- 
sional Paper on ** Self-Employment Pro- 
grams for the Unemployed: Program 
Operation and Policy Research in 
Western Industrialized Countries , " Its 
intent is to propose a common method- 
ology for evaluating self-employment 



programs wherever found, based on an 
expert panel developed by the Organi- 
zation for Economic Cooperation and 
Development (OECD) in Paris. 

The conclusion of the authors, who 
remain unamed in the paper, is that 
most European programs have been 
studied using a descriptive research de- 
sign and survey methods, particularly 
surveys of participants. Periodic sur- 
veys have formed a longitudinal data- 
base for analyzing process issues and 
gross outcomes. 

In general, however, European E&T 
programs were not systematically eval- 
uated in the 1980s. Of the 17 OECD 
countries with operating self-employ- 
ment programs, 10 had not produced 
evaluation reports. Most of the evalua- 
tions conducted had been limited to 
process issues, in the context of weak 
public sector support for and experi- 
ence with impact evaluations. In the 
E&T field, this may have been related 
to the tendency for European universi- 
ties to produce many more excellent 
theoretical economists than applied 
econometricians. 

In their discussion, a major differ- 
ence surfaces between contemporary 
American evaluation approaches to 
new program initiatives and European 
orientations. With respect to self-em- 
ployment programs, for example, Euro- 
pean governments have not been under 
pressure to test new ideas through dem- 
onstration projects. Programs there are 
more often than not the products of 
government agency policies that tend 
not to be dependent on the results of 
evaluations. 

Under public pressure to establish 
accountability, aided and abetted by the 
elaboration of the evaluation research 
field, the pattern in the US,, particu- 
larly beginning in the 1980s, was to 
test innovations or reforms in well- 
planned small-scale pilot projects that 
could be evaluated using experimental 
or quasi-experimental research designs 
prior to full-scale adoption. Exceptions 
existed, of course, such as JTPA, al- 
though its design benefited indirectly 
from previous E&T research on CETA 
and other programs. And a large num- 
ber of experimental evaluations of 
work/welfare demonstrations preceded 
and were fed directly into the design of 




the JOBS program. 

In considering what to propose as a 
common methodology for evaluating 
diverse self-employment programs, the 
authors turned to the OECD panel. This 
group of experts identified six major is- 
sues that could and should be studied: 

■ How important the provision of 
government assistance for business 
start-up really is. 

■ To what extent business ventures 
generated by programs would have 
occurred in their absence. 

■ Whether the methods used to target 
services to subgroups within the eli- 
gible population are effective. 

» How long program effects seem to 
last. 

• How cost-effective programs actual- 
ly are. 

■ How programs affect potential fu- 
ture dependence on unemployment 
insurance and other income support 
programs. 

Appreciative of these issues, the au- 
thors of the paper suggest a very simple 
evaluation paradigm. Program elements 
are classified either as ‘‘inputs” or “out- 
puts,” and the evaluator’s task is to de- 
termine how die inputs affect the out- 
puts, or at least what kinds of 
relationships exist between them. In- 
puts are: 1) targeting services, 2) vet- 
ting service (selecting among the busi- 
ness plans submitted), 3) financial 
services, and 4) support services (an ar- 
ray of technical bitsiness-related servic- 
es). Outputs for participants are em- 
ployment and business retention. 
Outputs related to economic develop- 
ment goals are the generation of eco- 
nomic development activities and the 
creation of new jobs. 

Emphasis is placed, in this para- 
digm, on 1) the adequacy of databases 
supporting evaluation, including infor- 
mation on the background and charac- 
teristics of clients, information about 
the services received, and performance 
indicators, and 2) the collection of data 
over time. The autliors also suggest a 
series of indicators which they classify 
within these categories: 1) employment 
for the proprietor, 2) enhanced business 



36 



44 



Evaluation Fofum . Issue 11 . Summor 100S 



Features « Defense Conversion and Dislocation 



survival rate, 3) contribution to the lo" 
cal and macro economy, and 4) new job 
creation. They appropriately recom- 
mend the use of measures of job dis- 
placement. They review problems with 
descriptive and quasi-experimental re- 
search designs and advocate for experi- 
mental approaches in determining pro- 
gram effects. 

Commentary on the Wiedom of 
Seif’Employment Strategies for 
Dislocated and Otherwise 
Unemployed Workers 

We have learned a great deal from 
the projects generated by the increase 
in dislocation in the 1980s and the U.S. 
government’s strong response in ex- 
ploring a range of service options using 
state-of-the-art evaluation research 
principles and methods. Some of the 



main lessons are that self-employment 
is most appropriate for a very small, se- 
lect group of dislocated workers vriio 
are highly motivated, disciplined and 
planning-oriented in the way they go 
about developing businesses supported 
by government income support and 
training. These program participants 
must also be risk-takers of a sort, will- 
ing to try something new with all the 
attendant anxieties. The results from 
the final report may shed more light on 
the effectiveness of self-employment 
strategies. 

Therefore it looks as if effective re- 
cruitment and screening strategies will 
be essential to install at the front end of 
microenterprise development programs. 
Ways to sustain motivation and disci- 
pline will surely be important. And it is 
fairly clear that the training must be tai- 
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Cutbacks in the defense budget re- 
lated to the end of the Cold War have 
been heralded by the American public 
as a bonus, a symbol of a less danger- 
ous world, a chance to transfer savings 
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Defense Downsizing: 
Some Implications 

The Cold War ended in dramatic 
changes in the political economy of de- 
fense in the U.S. Its demise spawned a 
new vocabulary as well — teims such 
as “drawdown;* “downsizing” “con- 
version ” and “transition.”* The impli- 
cations of the end of tne Cold War for 
workers affected by reduced defense 
spending has been equally dramatic. 
The U.S. Department of Education’s 
1993 report^ The Conference on the 



'The Defense Conversion Commission with- 
in the U.S. Department of Defense defines con- 
version as “the process by which the people, 
skills, technology, equipment and facilities of 
defense are shifted into alternative economic ap- 
plications ” It views conversion as **a process of 
transition.^ 



to the resolution of pressing societal 
problems. But the changing budget for- 
tunes of the Department of Defense 
have not yielded all the positive effects 
anticipated. Anxiety remains about de- 
fense readiness In a world complicated 
by ethnic, religious and territorial con- 



Role of Education in Restructuring De- 
fense and Other Industries reminds us 
that the U.S. Department of Defense 
has been and remains the nation’s larg- 
est employer. Furthermore, as an em- 
ployer it is known for its integration of 
education and training with the culture 
of work, and its incorporation of new 
technology within skills acquisition. 

Given rather unique opportunities 
for education, training and retraining 
within the military, unprecedented 
drawdown and downsizing in the 1990s 
represent an unusual test of the rele- 
vance of military training for the civil- 
ian economy. Since these changes have 
involved a major dislocation of work- 
ers within and outside the military, in- 
novative strategies have been essential 
to reducing the negative consequences 
of dislocation. 



lored to the individual and his or her 
business, with ongoing case manage- 
ment that emphasizes technical assis- 
tance as well as other kinds of support. 

This is a somewhat different concept 
of microenterprise development than in 
Eastern Europe and third world coun- 
tries, where it is offered as a significant 
intervention for large groups of xinem- 
ployed workers. For example, in the 
early 1980s the Chinese government 
stressed self-employment as a major di- 
mension of the liberalization of the 
economy, only to find that business 
failures outnumbered successes five 
years later. Carefully targeted self-em- 
ployment programs, on the other hand, 
appear to have contributed effectively 
both to job creation and to economic 
development. 



filets, and about the impact of defense 
restructuring on military personnel, de- 
fense-dependent communities, and de- 
fense-related businesses and Indus- 
tries. The following set of articles 
explore some of the issues involved In 
this phenomenon of the 1990s. 



Background Information 

At the end of fiscal year 1987, the 
active duty military was at a post-Viet- 
nam peak of 2,174,217 positions. The 
National Defense Authorization Act of 
1991 projected a strength of 1,613,000 
positions by the end of 1995. This was 
about a 25% reduction. By 1997, De- 
partment of Defense outlays were ex- 
pected to decline by approximately 
30%. This could represent a loss of as 
many as 800,000 military and civilian 
Department of Defense (DOD) jobs be- 
tween 1987 and 1997, and could affect 
as many as a million additional private 
sector jobs over the next several years. 

Although the U.S. has always lost 
and replaced large numbers of military 
personnel every year, this significant 
multl*year downsizing effort has trans- 



Evaluiitlon Forum • Issue 11 • Summer 1095 



45 



37 










Features ■ Defense Conversion and Dislocation 



4iiQ 



lated to far greater personnel change 
than is traditional, with the potential for 
a high level of involuntary separations. 
Clearly there has been a long-temi re- 
structuring of the nation’s defense pri- 
orities. As a result, the Congress autho- 
rized a range of assistance efforts in the 
1990s to facilitate downsizing, while 
minimizing its impact on the individu- 
als, businesses and communities affect- 
ed. 

The first priority of the Defense De- 
partment has been to achieve voluntary 
reductions. It has successfully drawn 
down military forces across various 
skill and seniority sectors using strate- 
gies that will have the least negative 
impact while maintaining the level of 
experience needed. However, as the 
U.S. General Accounting Office (GAO) 
pointed out in their September 1993 le- 
port. Military Downsizing, significant 
additional reductions will result in a 
larger proportion of involuntary reduc- 
tions, A recent Bottoms-^Up Review of 
DOD needs and programs for 1995 
through 1999 supports this conclusion. 
We should keep in mind, however, that 
the impact of this current drawdown is 
considered by experts to be smaller 
than that of the drawdowns after the 
Korean War and Vietnam, and less se- 
vere than other recent economic dislo- 
cations. 

Strategies for Limiting 
Involuntary Separation 

Early release of personnel prior to 
the normal end of their enlistments has 
been one strategy. Another has been fi- 
nancial separation incentives to induce 
people to leave. The Defense Authori- 
zation Act of 1992 and 1993 supported 
the use of financial incentives through 
1995 for those who had completed six 
years of service at the time the law was 
enacted. New early retirement options 
have been used also. On the involun- 
tary reduction side, DOD has tightened 
the quality standards for retention and 
has created special boards tliat can 
mandate the retirement of selected per- 
sonnel from among those already eligi- 
ble for retirement. 

The careful shaping of a smaller 
military force has favored the retention 
of the more skilled and experienced 



personnel, which is important. But we 
still have issues to resolve regarding in- 
voluntary separation. The GAO report 
recommended that the Congress con- 
sider extending the use of financial sep- 
aration incentives beyond 1995, and 
amending the legislation to include in 
the eligible pool for incentives all per- 
sonnel who have attained six years of 
service within the timeframe for which 
these incentives are authorized. 

The Role of the Defense 
Conversion Commission 

The creation of the Commission 
within DOD was an important step in 
dealing with the issue of dislocation. It 
provided a framework for monitoring 
and judging the process and conse- 
quences of the defense drawdown. It is 
a key source of recommendations for 
resolving problems, and for embracing 
new possibilities associated with con- 
version. 

The Commission’s 1993 report, 
justing to the Drawdown, explains its 
assessment goals and methods, which 
now provide general guidance to feder- 
al efforts to make the conversion pro- 
cess work. The Commission’s four 
goals are: 

1. To facilitate the transition by encour- 
aging economic growth over the 
long run, 

2. To preserve defense capabilities, 

3. To ease the impact on workers, com- 
munities and companies. 

4. To improve government policies and 
programs in terms of their efficiency 
and effectiveness. 

The Commission recognized that eco- 
nomic growth was a critical factor in 
facilitating conversion and alleviating 
its negative effects, and took the posi- 
tion that this growth should come from 
redirecting defense resources into in- 
vestment rather than consumption. 

With respect to easing the impact of 
conversion, the Commission felt broad- 
er use needed to be made of integrated 
community-level planning, encouraged 
and supported by the federal govern- 
ment. To improve existing government 
assistance programs, the Commission 



recommended a set of principles and 
criteria for evaluating these programs, 
with strong emphasis on specifying ob- 
jectives and using quantitative mea- 
sures to judge how well these objec- 
tives were being achieved. Greater 
coordination across old and new pro- 
grams was given high priority. Overall, 
the Commission felt that the conversion 
process was, in itself, an opportunity to 
make improvements. 

This upbeat altitude was reinforced 
by tlie Commission’s computer simula- 
tions regarding the longer-term conse- 
quences of the drawdown. These were 
generally optimistic. Analysts predicted 
that the drawdown’s main short-run ef- 
fect would be a slight downward pres- 
sure on output and a temporary in- 
crease in unemployment. But if defense 
spending were to be replaced mainly by 
investments in plants and equipment, 
human capital, and research and devel- 
opment, the prediction was that eco- 
nomic growth might actually speed up 
over the longer-term. Since general 
economic growth has been such an im- 
portant tool in reducing the impact of 
drawdowns, the Commission felt the 
Administration and the Congress 
should give special attention to invest- 
ment tax credits, banking reforms, defi- 
cit reduction, education reform, the re- 
moval of trade barriers, tax reform, and 
increased spending on infrastructure. 

Assisting the Dislocated 

The complex network of assistance 
efforts funded by the Congress in the 
1990s is very difficult to sort out. Em- 
ployment and training administrators, 
managers and evaluators clearly need 
to learn more about the many federal 
efforts to assist the defense conversion 
transition. And these efforts need great- 
er integration. 

In the meantime, one important 
source of information is the Office of 
Economic Conversion Information 
(OECI). This office is the result of a 
collaborative effort on the part of the 
Economic Development Administration 
and the Economic and Statistics Ad- 
ministration within the U.S. Depart- 
ment of Commerce, and the Office of 
Economic Adjustment in DOD. The 
OECI manages a major information 
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clearinghouse on defense conversion 
relevant to workers, communities and 
industries. This automated system pro- 
vides information on current press re- 
leases and legislation, publications and 
resource materials, worker adjustment 
programs, and related issues. 

Anotlier source is the Logistics 
Management Institute (LMT), a private 
nonprofit research and development or- 
ganization established in 1961 and 
funded by DOD. Its new Center for De- 
fense Conversion and Economic Re- 
newal produces policy, economic, and 
fiscal management analyses and offers 
access to a number of databases on eco- 
nomic adjustment challenges. The data- 
bases focus on two sets of issues: de- 
fense activity, and federal, state and 
local adjustment programs. 

Congressional funds for assistance 
programs have flowed mainly to the 
DOD and from there to other relevant 
federal agencies, such as the Depart- 
ments of Labor and Commerce. One of 
the Logistics Management Institute’s 
major assignments in providing input 
to the Defense Conversion Commission 
has been to prepare an exhaustive Com- 
pendium to Assist the Transition, This 
compendium provides a description of 
each program, its sponsor, the organi- 
zation responsible for its implementa- 
tion, and the amount of its funding. 

This information helps considerably in 
sorting out the spectrum of programs 
for different kinds of recipients. 

Transition assistance in the form of 
retraining and reemployment for af- 
fected workers has been considered 
critical. However, a broad-range strate- 
gy appears to be needed that simulta- 
neously invests in sound, appropriate 
worker training, assistance to business- 
es to increase their performance, re- 
search and development assistance to 
advance technology, and help with eco- 
nomic development efforts. A recent 
report by the Office of Technology As- 
sessment (OTA) of the U.S. Congress, 
After the Cold War: Living With Lower 
Defense Spending, has recommended 
this kind of approach. 

The authors of the OTA report re- 
mind us that in 1991 national defense 
employed approximately six million 
people in the private sector, in the ac- 



tive duty military, and in the DOD ci- 
vilian sector. This was 5. 1% of total 
national employment. The authors pro- 
pose that as many as 2.5 million de- 
fense-related jobs could disappear by 
2001. They point out, however, that not 
all of this shrinkage means actual job 
loss, since approximately three- fourths 
of this downsizing will be through at- 
trition. 

The larger problem, they suggest, is 
the extent of employment losses in any 
one period, large declines in any given 
period making readjustment more diffi- 
cult. Eight of the fifty states are above 
average in their dependence on the de- 
fease industry. And even with the 
present level of economic recovery, it 
is hard to replace the well-paid jobs de- 
fense manufacturing has offered. There 
is also the issue of minorities. Of all 
employed black men between eighteen 
and twenty-nine, 10.6% are in the mili- 
tary compared with 5.4% of white 
males. The shrinkage of the defense es- 
tablishment may represent a major loss 
of employment opportunities for minor- 
ities. 

The Larger Picture 

The OTA report also indicates that 
communities at serious risk due to de- 
fense cutbacks are not receiving as 
much assistance as they often need. 
Federal economic development pro- 
grams have lacked funding perennially. 
Defense-dependent communities re- 
ceived an additional 50 million for 
1991 through 1993, but this was still 
much less than the amounts available in 
the past. And states have had difficulty 
sustaining imiovative economic devel- 
opment projects. In this context, the re- 
port contained some useful recommen- 
dations: 

■ Deliver services more promptly. 

■ Target communities in greatest need. 

■ Supplement state programs. 

■ Offer a range of technical assistance 
to help companies grow rather than 
attempting to motivate them through 
tax subsidies. 

Another complication the report 
gives attention to is the reluctance of 
major defense contractors to initiate 
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large-scale dual-use conversion 
projects, believing that the differences 
between defense and civilian cultures 
and practices are too great. Producing 
components and subsystems rather than 
final products, the report states, is more 
likely to launch dual-use production. 
Government technical, marketing and 
financial assistance is viewed as impor- 
tant in helping firms move into more 
commercial activities. 

A second OTA report in 1993, D^- 
fense Conversion: Redirecting R&D, 
also offers usefiil insights and recom- 
mendations about converting defense 
industries and their research and devel- 
opment efforts. The latter is a signifi- 
cant issue in that the defense complex 
has supported a disproportionate share 
of U.S. research and development, 
some of which has important civilian 
applications. It has established major 
civilian industries, and has afforded 
high-quality, well-paid jobs. Some of 
this R&D provided a large market for 
technologically advanced goods and 
services. Relevant to tliese spinoffs, the 
report admonishes the government not 
to waste the valuable human, institu- 
tional and technological resources for- 
merly assigned to defense purposes. 

This second OTA report also sug- 
gests ways to re-use these defense-re- 
lated resources, such as the develop- 
ment of new environmental protection 
occupations, the creation of renewable 
energy sources, the development of 
high energy-efficient and non-polluting 
transportation systems, and the produc- 
tion of a new generation of high-per- 
formance computers and networks. As 
with most phenomena of tiie proportion 
represented by current defense conver- 
sion activities, multiple, coordinated 
strategies are required. We no longer 
fear global nuclear war. With the end 
of the Cold War we have the freedom 
to work toward national goals other 
than military security. Many experts in- 
sist we must use this opportunity to 
move forward as an economic competi- 
tor in an international marketplace — 
and at the same time ameliorate the 
hardships experienced by defense 
workers, defense-dependent communi- 
ties, and defense companies during this 
transition period. 
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Studying Defense 
Conversion 
in Affected 
Communities 

In this article we look at an interest- 
ing 1993 study of seven sites in the 
U.S. that have been impacted signifi- 
cantly by defense cutbacks. The study 
w^s sponsored and funded jointly by 
the Economic Development Adminis- 
tration (EDA) of the U.S. Department 
of Commerce and the U.S. Department 
of Defense’s Office of Economic Ad- 
justment, and conducted by the North- 
east-Midwest Institute. The study re- 
port, Defetise Adjustment and 
Conversion: Lessons from Seven Sites, 
is the basis for the review. 

The Nature of the Study 

The sites selected for the process 
study were San Diego, Minneapolis, In- 
dianapolis, Albuquerque, Bath (Maine), 
and Sunnyvale (California). The re- 
searchers used focus groups in each site 
to explore how defense cutbacks were 
affecting workers, businesses and com- 
munities; what plans local leaders had 
developed for coping with the conse- 
quences: and how these communities 
could promote effective economic ad- 
justment and diversification. 

The additional purpose of the focus 
groups was to support coordination 
among key actors and constituencies in 
these communities and some level of 
agreement about what action should be 
taken. To achieve this latter purpose, 
focus group participants were provided 
with information obtained from case 
studies of defense adjustoent and con- 
version, and from programs designed to 
resolve problems associated with mili- 
tary cutbacks. They were encouraged to 
discuss how the roles and responsibili- 
ties of the different kinds of organiza- 
tions and groups participating in the fo- 
cus groups should be defined, in the 
process of developing strategics for 
solving problems in their own commu- 
nities. 

The Larger Context 

The authors of the study report, 
Charles Bartsoh, Paula Duggan and 



Matt Kane, propose that in the larger 
economic environment military cut- 
backs will have p beneficial effect on 
the national economy, releasing funds 
for deficit reduction. However, the im- 
pact on particular regions and indus- 
tries clearly varies. The variation is in- 
fluenced, they say, by the following 
factors; 

" The size of the cuts. 

• Thespeed with which they are 

made. 

■ The mix of cuts vis-a-vis procure- 
ment, operations and/or personnel. 

« The overall strength of the U.S. 

economy at the time of the cuts. 

The authors give us an important 
glimpse of defense expenditures, to 
provide a background for understand- 
ing the implications of defense down- 
sizing. About 75% of defense purchas- 
es are made from manufacturing 
industries; 21% from the service sector. 
The rest is from construction, agricul- 
ture and mining. More than 15% of the 
total output of 31 industrial sectors in- 
volves defense-related activities. At 
least 29 of these industries manufacture 
durable goods. Some estimates indicate 
that as much as 57% of military-related 
employment is in the manufacturing 
sector. 

Recognizing the effect of reduced 
puit:hasing in this sector, the U.S. De- 
partment of Defense (DOD) has re- 
formed its regulatory procedures to as- 
sist companies in defense-dependent 
industries — in order to reduce their 
costs, and to become more competitive. 
The DOD has also eliminated “recoup- 
ment fees,” or reimbursements much 
like royalties, that private companies 
on federal contracts had to contribute to 
the federal government when they de- 
veloped products or technologies that 
became viable in the civilian market. 

In terms of employment, although 
the portion of the labor force in de- 
fense-related businesses and industries 
is small, it is nevertheless significant. 

In 1989, the authors indicate that about 
3.4 million private sector workers were 
employed directly or indirectly in de- 
fense-generated jobs — about 5% of 
the total labor force* Eleven industries 



that were highly dependent on the de- 
fense budget at that time employed 
nearly 1 .8 million workers. In industri- 
al sectors such as guided missiles, ship- 
building, ammunition development, 
and tank construction, 75% of workers 
owed their jobs to defense spending. 

This defense workforce differs in 
important ways, the authors propose, 
from the average labor pool. It consists 
largely of professionals, skilled and 
semi-skilled craft workers, clerical 
workers, and fairly skilled support 
staff. The Office of Technology As- 
sessment of the U.S. Congress conclud- 
ed in their 1992 study of the defense 
workforce that it was more highly 
trained and skilled than workers in oth- 
er sectors of the economy. Its workers 
were making high wages. These char- 
acteristics clarify what a substantial im- 
pact sudden job loss can have in terms 
of the reemployment challenge. 

The change in the fortunes of the de- 
fense workforce must be understood in 
the context of the trend in manufactur- 
ing jobs since the late 1970s. The 
occupations most at risk have been in 
manufacturing areas — engineers; tech- 
nicians in engineering and science; 
computer specialists; craft and similar- 
ly-skilled production workers; and less 
skilled operators and laborers. Overall, 
manufacturing jobs have not risen since 
the late 1970s and have fallen by 5% 
since 1990. 

Areas with a high concentration of 
advanced technology firms and military 
bases have been the hardest-hit. Eight 
states accounted for about one-fiftli of 
the defense spending in 1991. States 
with a large number of military bases 
and facilities had become the most de- 
pendent. The Congressional Budget Of- 
fice reported in 1992 that a defense re- 
duction of 20% between 1991 and 1995 
could result in a significant output loss 
in the District of Columbia and ten 
states. Commercial-sector jobs associ- 
ated with defense production are affect- 
ed in these areas as well. 

Federal Assistance for 
Adjustment Purposes 

The Defense Conversion, Reinvest- 
ment and Transition Assistance Act of 
late 1992 authorized a set of new pro- 
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grams responsive to the difficulties be- 
ing experienced by certain businesses 
and industries, and by whole communi- 
ties, as a result of defense cuts. Much 
of the funds for these programs flowed 
to beneficiaries in fiscal 1993. Some of 
the funds were channeled into existing 
economic development, worker train- 
ing and education programs, but a por- 
tion went to new initiatives. Some of 
these were expected to enhance manu- 
facturing competitiveness by emphasiz- 
ing “critical technologies” and “dual- 
use technologies:” 

■ Commercial-Military Integration 
Partnerships: the DOD was to work 
with high-tech firms to develop and 
commercialize high-payoff applica- 
tions for dual-use technologies. 

■ Regional Technology Alliances As- 
sistance Program: funding was to 
enable the developnaent of alliances 
among defense firms (and prime 
contractors) to develop and apply 
critical defense technologies for dual 
use — defense and civilian — with 
an emphasis on regional diversifica- 
tion in defense-dependent areas. 

■ National Defense Manufacturing 
Technology Program: the federal 
government was expected to engage 
small defense firms in using military 
technologies as a base for diversifi- 
cation. 

■ Technology Transfer Initiatives: 
these were to encourage private sec- 
tor businesses to transfer military 
technology for civilian use. 

■ Defense Advanced Manufacturing 
Technology Partnerships: DOD 
was to share the costs borne by firms 
in developing and applying manu- 
facturing technologies for military 
and civilian production. 

■ Manufacturing Extension Program: 
this program was to improve the 
competitiveness of manufacturing 
technology. 

■ Dual-Use Extension Program: this 
involved a number of programs to 
assist defense suppliers in making 
the transition* 



» Small Business Innovative Research 

Program: this program increased 

DOD’s R&D funds directed to small 

businesses. 

Looking at the funneling of DOD 
dollars through multiple programs ben- 
efiting the American economy general- 
ly, one cannot avoid exploring iss)ies of 
corporate charity and the need for pro- 
gram consolidation. Congress provided 
$694 million to assistance programs 
targeted to the private sector in the 
1992 legislation. 

Assistance to Workers 

While the issue of equity was raised 
by this large allocation to businesses, 
$686 million was being directed to 
worker adjustment programs. Most of 
these programs assisted military per- 
sonnel separating from the service and 
civilian workers employed by DOD. 

The programs are providing separation 
counseling, incentives for early retire- 
ment, extended benefits such as health 
care, increased training for civilian oc- 
cupations, and the establishment of hir- 
ing preferences for these workers in 
government jobs. Seventy-five million 
of the total funding is to be used for a 
new program for dislocated workers 
similar to DOL’s EDWAA — although 
DOD was given the option of simply 
adding this amount to JTPA Title III. 
DOD is to notify defense contractors of 
federal cuts affecting them, and will re- 
quire them to post jobs with the Em- 
ployment Service. The legislation also 
requested educational institutions to 
provide training in environmental occu- 
pations. 

Assistance to Communities 

The budget earmarked for communi- 
ty assistance in the 1992 legislation 
was $132 million. Eighty million of 
that was to be transferred from DOD to 
EDA in the U.S. Department of Com- 
merce. In addition, DOD’s Office of 
Economic Adjustment received in- 
creased funding to permit the dispibu- 
tion of both planning grants and imple- 
mentation grants for assisting 
communities, of the kind already dis- 
tributed by the EDA* 



The Results of the Seven-Site 
Study 

Two major themes ran through the 
* recommendations of private sector par- 
ticipants in the focus groups: 

IB Remove regulatory and administra- 
tive barriers that impede the adapta- 
tion of dual-use technologies: 

♦ Accounting requirements. 

♦ Proprietary rights limitations. 

■ Increase government support for di- 
versification and adjustment pro- 
grams designed to help defense-de- 
pendent companies shift to civilian 
markets: 

♦ Technical assistance. 

♦ Advice on gaining access to the 
technologies necessary for the 
shift. 

♦ Advice on marketing strategies. 

♦ Information about new markets. 

Public sector participants wanted gov- 
ernments at all levels to adopt a more 
flexible approach to worker training, 
the financing of economic develop- 
ment, and to other programs. Although 
the sites were quite diverse, the focus 
groups yielded common proposals: 

■ Business leaders should identify al- 
ternative operating scenarios and be 
prepared to restructure their busi- 
nesses so as to be competitive in ci- 
vilian markets. 

■ Defense-related companies need a 
range of information to increase 
tlieir export potential: 

^ Identification of overseas mar- 
kets. 

♦ The defining of prospective mar- 
ket “niches.” 

♦ Information about mechanisms 
linking U.S. manufacturing capa- 
bilities and technologies with 
prospective foreign purchasers. 

♦ Information about how to target 
markets with growth potential. 
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■ Worker adjustment program rules 
and regulations should be more flex- 
ible, to allow defense-related dislo- 
cated workers to be better served. 

♦ Increased ability to launch pub- 
licly-funded retraining programs 
prior to the loss of a job — for 
example, training for new tech- 
nologies as part of a company 
conversion or product diversifica- 
tion project. 

♦ Better information on emerging 
new skills and tlisir mesh with 
existing work skills. 

K More specialists in commercial man- 
agement, productivity, marketing 
and purchasing need to be produced. 

■ A successful business retention 
strategy should be developed, target- 
ed to defense-oriented companies. 

■ Acquisition of capital should be 
more accessible and affordable, to 
carry out defense adjustment poli- 
cies and strategies. 

■ DOD should adopt a more quality/ 
results-oriented approach to military 
procurement that places less stress 
on detailed specifications. 

■ There should be greater support for 
the development of “critical technol- 
ogies’' by small businesses, to in- 
croase the number of high-quality 
employers and reliable specialized 
vendors for defense-related parts 
and components. 

■ DOD’s proprietary rights regarding 
the dissemination of information 
should be limited, to increase the in- 
tegration of military and commercial 
production. 

■ DOD policies and regulations that 
fit the Cold War but now interfere 
with efforts to convert or scale back 
production should be eliminated, 
within the goal of maintaining criti- 
cal technologies. 

9 DOD stipulations regarding cost and 
pricing data, certifications and au- 
dits should be overhauled. 



■ There should be a study of 1) key 
defense-related industries, 2) work- 
forces and 3) skill needs by the fed- 
eral government, and a national in- 
dustrial agenda should be developed 
— or at the least defense manufac- 
turing policies should be coordinat- 
ed — to ensure that necessary tech- 
nologies and production capabilities 
can be maintained. 

Some Final Study Conclusions 

The authors conclude that a success- 
ful adjustment strategy must “bring a 
high level of visible participation and 
commitment” to this effort by local po- 
litical and business leaders. Simple in- 
terest in the problem will not suffice. 
Communities need to launch formal 
needs assessments and planning pro- 
cesses which speed adjustment efforts. 
Those sites that had established formal 
planning structures and processes were 
making the greatest progress. They had 
used a series of meetings and surveys 
to identify the potential magnitude of 
the problem, the nature and scope of 
existing workforce skills and manufac- 
turing capability, and other information 
needed to construct a workable adjust- 
ment strategy. This information base 
was considered essential to the achieve- 
ments realized. 

The following kinds of information 
were recommended for this information 
bank: 

■ Numbers of workers employed and 
unemployed. 

■ Numbers of actual and likely plant 
closings, and what industrial sectors 
they represented. 

■ Numbers of workers on layoff from 
defense-oriented companies, and 
their skills. 

■ Kinds of emerging industries in the 
area, and the types of workers they 
were likely to hire. 

■ Information on the education, train- 
ing and social service resources 
available. 

■ Job creation information. 



The participants in the focus groups 
also felt that each community’s defense 
adjustment effort required a mechanism 
for initiating, organizing and maintain- 
ing action, such as a person, group or 
organization that commanded commu- 
nity respect and support, and could 
serve as a focal point for policy devel- 
opment, planning and oversight activi- 
ties. 

implications of the Study for 
Different Levels of Government 

The focus groups placed an unam- 
biguous emphasis on 1) a national dual- 
use business and industrial policy, ac- 
companied by increased federal 
technical and financial assistance to 
state governments, defense-oriented 
employers, and local communities af- 
fected by downsizing, and 2) greater ef- 
forts on the part of community political 
leaders, government agencies and the 
private sector to identify the array of 
needs due to defense cutbacks, and to 
take well-organized action to reduce 
the negative fall-out. 

The thrust of the stud/ has important 
implications for current federal efforts 
to consolidate and otherwise coordinate 
workforce development policies and 
programs, and integrate their informa- 
tion systems — and for states’ new 
efforts to establish comprehensive 
state-wide councils responsible for ac- 
complishing the same goals. The major 
message would seem to be that defense 
adjustment requires a multi-dimension- 
al strategy involving assistance to dis- 
located workers placed within the larg- 
er context of assistance to businesses 
and communities. 

The recommendations flowing from 
this study would suggest strongly that 
the Departments of Defense, Com- 
merce, Labor, and Health and Human 
Services should increase their coordi- 
nation and collaboration on defense ad- 
justment issues, and that state work- 
force development systems should 
incorporate economic development 
agencies within their formal structure 
and functions. 
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Programs to Ease 
the Adjustment to 
Defense Cutbacks 

In the early 1990s, the Defense Con- 
version Commission in1he U.S. De- 
partment of Defense funded the Logis- 
tics Management Institute (LMI) to 
analyze and classify information about 
the myriad programs providing some 
kind of assistance to individuals, busi- 
nesses and communities related to de- 
fense downsizing. LMI subsequently 
collected data on these programs and 
interviewed a large number of federal, 
state and local officials about them. 
Their effort produced the Compendium 
of Programs to Assist the Transition^ 
published in Feburary 1993. 

The Compendium includes pro- 
grams in existence prior to the National 
Defense Authorization Act for Fiscal 
1993, and those initiated through this 
legislation and some of the legislation 
that followed. Sixty-one of the 144 pro- 
grams were sponsored by state and lo- 
cal communities, even though the latter 
were sometimes utilizing federal funds. 

The Nature of Assistance 
Progranrts 

The major assistance programs in 
the Compendium are federally-funded 
and emphasize training and economic 
development. They tend to serve as the 
ultimate safety net for individuals af- 
fected by defense cuts and drawdowns. 
Programs targeted to industries stress 
development and technology transfer. 
Almost all state programs involve job 
training oriented to job retention or re- 
employment. Industry programs also 
concentrate on worker training, as well 
as industrial development. Service deliv- 
ery for federally-funded programs are the 
responsibility of states, while local pro- 
grams are directed mainly to local em- 
ployment and economic development. 

The Compendium is well organized 
and detailed, reviewing separately pro- 
grams for individuals vs. programs for 
states and communities, according to 
their funding sources. Figure I lists the 
programs for individuals, summarizing 
selected federal programs for workers 
displaced from the military and/or de- 
fense-related employment 



A number of states have their own 
programs covering ser\'ices to dislocat- 
ed military and workers in defense- 
related businesses and industries. Im- 
portant examples are California’s Em- 
ployment and Training Panel, New 
York’s Skills Training Program, and 
Washington State’s Job Skills Program 
and vocational education effort. 

Clearinghouse Activity 

The DOD and Department of Com- 
merce jointly maintain a useful clear- 
inghouse, the OECI Clearinghouse, 
which tracks the assistance provided to 
individuals, businesses and communi- 
ties in the plethora of programs created 
due to defense restructuring and down- 
sizing. For example, summaries are 
available for the Defense Industry Ad- 
jmtment Projects break dov/n in- 
formation by type of award granted to 
states — state planning grants, ad- 
vanced planning grants, and defense in- 
dustry adjustment grants — and de- 
scribe each project. 

Recent Initiatives 

In March 1995, President Clinton 
announced a new five-year package of 
programs under the Defense Transition 
Program. These were mainly reinvest- 
ment and transition programs devel- 
oped by the Congress but not imple- 
mented by the Bush Administration. In 
the President’s FY 1995 budget re- 
quest, funding for four categories of 
programs was requested: workforce, 
community, dual-use technology, and 
non-defense ^vchnology. Under work- 
force initiatives, the main interest was 
in separation pay and retirement incen- 
tives, and in education and training. 

Out of the seven education and training 
programs recently established by Con- 
gress, the President chose to emphasize 
two that trained active duty military for 
public service-oriented jobs, the 
“troops to teachers” and “troops to 
cops” programs. 

Not included in the funding request, 
however, were three environmental ed- 
ucation programs authorized in the FY 
1994 Defense Authorization Act, and 
funding for the Occupational Training 
Program that was to partially reimburse 
firms for the cost of employer-provided 
training if these firms hired and trained 



former military personnel. 

In 1994, rather than transferring de- 
fense adjustment funds from the DOD 
to DOL, DOL requested a general 
funding increase for dislocated worker 
programs. Congress provided over one 
billion in FY 1994 for dislocated work- 
er assistance in DOL, of which $125 
million was to be earmarked for de- 
fense workers. The Administration’s 
1995 request includes approximately 
$1.5 billion for Title III, with an esti- 
mated $195 million going to workers 
dislocated from defense-related em- 
ployment. 

Evaluation Mandates 

Conspicuously absent from descrip- 
tions of DOD programs for dislocated 
workers within, separated from, or out- 
side but related to the military is any 
mention of program evaluation. While 
Department of Education and DOL 
programs have substantial evaluation 
requirements, the DOD programs do 
not appear to have such requirements. 
Although the Defense Conversion 
Commission has taken a strong position 
on the need for performance measures, 
no performance management system 
comparable to that required for the 
DOL programs seems to be in place. If 
true, this would be a serious deterrent 
to sound policy development for this 
portion of the dislocated worker popu- 
lation. 

The Department of Education 
Report 

In May 1991, the Office of Educa- 
tional Research and Improvement 
(OERI) organized a conference to ex- 
amine the role of education in restruc- 
turing defense industries and ways to 
ameliorate the negative impact of such 
restructuring on workers. Much was al- 
ready known. In 1990, over 200,000 
active and reserve service personnel 
and veterans used educational benefits 
to help pay for their education. A study 
completed in 1976 had suggested that 
the earnings of veterans using Mont- 
gomery GI Bill benefits were 10% 
higher than they would have been oth- 
erwise. A subsequent study indicated 
that educational benefits used by Viet- 
nam-Era veterans and by servicemen in 
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Program and Funder 



Target Group 



lype of Assistance 



Involuntary Separation Pay Program 
DOD 



Montgomery Gl BUI 
DVA 

Post-Vietnam Era Assistance 
DVA 

Vocational Rehabilitation and 

Counseling 

DVA 

Voluntary and Special Separation 

Incentives 

DOD 

Defense Automated Transition 
Systems 

DOD 



Armed Services Career Alumni 
Program 

DOD 



Interagency Placement Assistance 

Program 

DOD 



Reemployment Priority List 
DOD 

Transition Assistance Program 
DVA/DOD 



Priority Placement Program 
DOD 

Displaced Employee Program 
All agencies. 

JTPA Title 111 
EDWAA 



Employment Service 
DOL 

Unemployment Insurance 
DOL 



Active members of military with 6-20 
years of service involuntarily separated 
from senrice. 

Active members of military and National- 
Guard. 

Same as above. 



Disabled veterans. 



Selected active members of military- 
officers, enlisted members — who agree 
to voluntarily leave military. 

All members of military separating from 
armed services. 



All armed services personnel in process 
of leaving ser\'ices, and their families. 



Members of militaiy leaving service. 



Members of military leaving service due 
to dislocation. 

Separating service members. 



Lump sum separation payment. 

Educational stipends. 

Same as above. 



Counseling, education, training, and 
support services. 

Series of annual payments or lump 
sum in return for voluntary separation 
and continuation in reserves. 

Job placement assistance. (The sys- 
tem is in cooperation with DOD’s Tran- 
sition Assistance Offices, which are of- 
ten co-located with family and commu- 
nity support centers.) 

Career guidance, benefits counseling, 
job search assistance. (Members of 
armed services leaving military receive 
certification of their job experience and 
skills while in military.) 

Job placement assistance, and the 
communication of the availability of 
these individuals for employment to the 
federal agencies. 

Listing of Individuals on priority list for 
federal jobs. 

Three-day job search assistance semi- 
nars through state Employment Ser- 
vice. 



Dislocated federal civilian employees. Job placement assistance. 



All federal employees involuntarily sepa- 
rated. 

Dislocated workers. 



All workers. 

Eligible unemployed workers. 



Job placement assistance. 

Rapid response assistance, training, 
basic readjustment assistance, needs 
related payments. (The 1993 National 
Defense Authorization Act amended 
Title III to establish discretionary pro- 
gram designed to respond to reem- 
ployment needs of 1) those at risk of 
dislocation and 2) dislocated military, 
DOD civilian personnel, and defense 
workers.) 

Job search and placement assistance. 



Fiscal benefits. 



Figure 1 continues 
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Progrsm and Funder 


Target Gfx>up 


Type of Assistance 


Jab Opportunities and Basie Skiiis 
Program (JOBS) 

HHS 


Adult recipients of AFDC. 


Educai(on, training, employment assis- 
tance, and support services. 


Federal Work Study 
DOE 


Higher education students needing 
. financial assistance. 


Financial aid. 


Federal Family Education Loans 
DOE 


Same as above. 


Stafford Student Loans, PLUS loans, 
and Supplementary Student Loans. 


Federal Pell Grants 
DOE 


Same as above. 


Educational grants, up to five years. 


FdderaB Supplemental Educational 

Opportunity Grants 

DOE 


Same as above. 


Undergraduate/graduate nonrepayable 
grants. 


Federal Perkins Loans 
DOE 


Same as above. 


Loans with delayed repayment. 


1980 Carl D. Perkint Vocational and 
Applied Technology Grants 
DOE 


Same as above. 


Vocational education grants. 


Service Members Occupational 
Conversion and Training Act of 
1992 

DOD 


Dislocated members of armed services. 


Six to eighteen months of occupational 
retraining. 








Program and Funder 


Target Group 


Type of Assistance 


Continued Health Coverage for 
Military and Dependents 
DOD 


Former service members and their 
families. 


Temporary health benefits. 


Skill Training Programs for 
Civilian Personnel 
DOD 


Dislocated DOD civilian employees. 


Occupational training. 


Separation Pay 
DOD 


Dislocated DOD civilian personnel. 


Lump sum payments. 


Teacher and Teacher’s Aid 
Placement Programs 
DOD 


Separated members of armed forces, 
terminated DOD civilian employees, 
displaced scientists/engineers working 
for defense contractors. 


Education to acquire teacher or teach- 
er aide certification, job placement as- 
sistance, stipend during first two years 
of teaching. 


Environmental Scholarship and 

Fellowship Programs 

DOD 


DOD employees. 


Fellowship for training in resource 
managemenl/restoration. (DOD also 
funds grants to higher education insti- 
tutions to provide training In environ- 
mental restoration and hazardous 
waste management.) 


Defense Diversification Program 

DOD/DOL 


Displaced military and employees of 
defense contractors. 


Transition adjustment and employment 
services. (Expansion of Interstate Job 
Bank Programs and coordination with 
Defense Outplacement Referral Sys- 
tem.) 


Acronyms: DOD Department of Defense; DOL •• Department of Labor; DOE ■■ Department of Education; 
DVA" Department of Veterans' Affairs; HHS - Department of Health and Human Services. 
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the all-volunteer army raised overall 
eemings for veterans by an average of 
about 6%, if used for college or gradu- 
ate school. These findings were consis- 
tent with other studies in the 1980s and 
1990s showing significant earnings 
gains for college graduates and those 
with graduate degrees. 

Another set of analyses offered simi- 
lar insights. The conference benefited 
from ten commissioned policy papers 
relying on relevant research. “Lessons 
from the Past: Mitigating the Effects of 
Military Cutbacks on Defense Work- 
ers ” by Lois Lembo and Judith Phil- 
lips, makes a substantial case for edu- 
cation as a vehicle for reducing the 
dislocation effects of defense cutbacks, 
and for ensuring that defense conver- 
sion contributes to workers and the 
economy. Burt Bamow and Amy 
Chasanov’s paper on “Firm-Based Ed- 
ucation and Training of Workers” il- 
lustates in a case study of the Xerox 
Corporation how companies can use 
education and training to maintain their 
economic health in the midst of unex- 
pected changes in federal budget priori- 
ties. 

If we are to determine the actual im- 
pact of the many DOD transition assis- 
tance programs, the kind of research 
expertise illustrated in OERI's report 
on the conference, Military Cutbacks 
and the Expanding Role of Education, 
needs to be applied to these programs. 
The Department of Labor and Depart- 
ment of Education research efforts 
would seem to offer useful models. 



mm 

Findings from the 
Defense Conversion 
Adjustment 
Demonstration 
Project 



Mary G. VIsher 

PUnnlng Associates 

Deborah Kogan 

Social Policy Resoar^h Assoclatos 



Background on Defense 
Conversion 

As a result of the end of the Cold 
War, outlays by the U.S. Department of 
Defense are projected to drop by 30% 
between 1987 and 1997. These reduc- 
tions in defense expenditures have af- 
fected defense industry workers and 
military personnel, private firms that 
are dependent on defense-related sales, 
and communities with military installa- 
tions and/or concentrations of defense 
firms. The term “defense conversion 
adjustment” refers to thiC process by 
which communities, firms, and individ- 
ual workers adjust to the defense dra*w- 
down. 

BE At the community level, defense 
conversion requires decision-makers 
to plan for and address the immedi- 
ate impacts of reductions in defense 
spending on affected firms and laid- 
off workers, while building a foun- 
dation for economic renewal by co- 
ordinating all available comxnunity 
resoui'ces. 

u At the firm level, defense conversion 
is the process by which defense-de- 
pendent firms develop new process- 
es and products that will enable 
them to compete in commercial mar- 
kets. Necessary changes may in- 
clude reorganization of the work- 
place and training workers and 
managci'S in new technologies and 
high performance workplace skills 
(HPWO). 



m At tine level of the individual work- 
er, defense conversion is the process 
by which defense industry workers 
and military personnel prepare 
themselves for jobs in the non-mili- 
tary commercial sector. 'Fhis con- 
version process may involve learn- 
ing new technical or occupational 
skills or how to adjust to corporate 
culture in tlie commercial sector. 

In May 1992 the U.S. Department of 
Labor (DOL) became directly involved 
with defense conversion when it an- 
nounced the availability of funds to 
support innovative strategies to assist 
workers, businesses and communities 
affected by downsizing.^ Twelve 
Round 1 DCA grants were awarded in 
November 1992, and another seven 
Round 2 grants a year later. Grants 
were awarded under several different 
categories: community planning, dislo- 
cation aversion, and increased worker 
mobility, reflecting the three different 
levels of impact from the defense draw- 
down.^ 

Overview of the DCA 
Demonstration Evaluation 

The Department of Labor contracted 
with Berkeley Planning Associates 
(BPA) to conduct an evaluation of the 
DCA Demonstration. The objectives of 
this evaluation, performed by BPA and 
its subcontractor. Social Policy Re- 
search Associates (SPR), are threefold: 
(1) to describe and document the im- 
plementation and short-term outcomes 
of the demonstration projects, as they 
relate to the specific problems faced in 
defense-Telated dislocations; (2) to 
Identify exemplary approaches to the 
specific problems faced in defense-re- 
lated dislocations; and (3) to identify 
the factors that contribute to or impede 
the success of various defense .conver- 
sion approaches. 



^Section 325(d) of Title III of the Job Train- 
ing Partnership Act provides funding for demon- 
stration projects as part of the Defense Conver- 
sion Adjustment Prognuti. 

^Due to limited space, in this summary we 
only report Hiidings from our observations of the 
projects using the two latter approaches. 
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The methodology for this evaluation 
emphasizes the collection of qualitative 
data using multiple site visits to each of 
the 19 demonstration projects, supple- 
mented by limited quantitative data on 
the characteristics of participating 
workers and firms, services provided, 
and outcomes achieved by participating 
workers and firms. This article, based 
on mid-project findings reported in the 
evaluation’s Phase I Final Report,^ 
summarizes findings on how the 
projects have fared thus far, and lessons 
that can be learned from their experi- 
ences. 

Evaluation Issues 

The evaluation is based on detailed 
case studies of each project document- 
ing project goals and objectives, the in- 
volvement of different project partners 
in developing and implementing the 
demonstration design, and progress to 
date in achieving project goals. These 
case studies have provided valuable in- 
formation on projects’ successes in im- 
plementing their intended designs as 
well as barriers to successful imple- 
mentation. 

Particularly challenging for this 
evaluation has been the assessment of 
project effectiveness using data on par- 
ticipant-level and firm-level outcomes. 
Since most of the projects are still in 
operation, final participant outcomes 
are not yet available. For projects as- 
sisting defense-dependent firms with 
defense conversion, the intended out- 
comes (e.g., increased non-defense 
sales and workforce stability or growth) 
may not be observable within the eval- 
uation time-frame, particularly for 
firms at the beginning of the conver- 
sion process. Even where firm-level 
outcomes are available, it is not clear 
whether and how demonstration-related 
activities, such as workforce training 
and strategic planning assistance, have 



^This report was submitted in draft to DOL 
in March 1995. The report consists of prelimi- 
nary findings on the three defense conversion 
approaches (worker mobility, defense conver- 
sion, and community planning) in Volume 1. 
Volumes n Uuough IV contain detailed project 
profiles for each demonstration project, orga* 
nized by approach. An exccuii summary will 
be available as ft sepairiely bound volume. 



contributed to the achievement of these 
goals. 

This study has not attempted to col- 
lect outcome data from comparison 
groups or sites to suggest what would 
have happened to participating workers 
or firms in the absence of ser\dces. In 
assessing project effectiveness, we have 
compared each project’s performance 
to its own stated goals, as well as to the 
outcomes achieved by other demonstra- 
tion projects testing similar approaches. 

Averting Layoffs at Defense- 
Dependent Firms 

Prc/jects 

Nine projects are testing dislocation 
aversion strategies. Figure 1 summa- 
rizes the dislocation aversion projects 
and their key features. Projects vary in 
the number of firms they are assisting, 
the size of participating firms, and the 
stage of participating firms in the con- 
version process. Some projects target- 
ed firms early in the adjustment process 
and supported managers during the 
process of planning for conversion. 
Other projects targeted firms that had 
already developed strategic plans for 
conversion and were ready for work- 
force training. 

Findings 

A sequence of steps is necessary for 
successful conversion, including identi- 
fying firm strengths and weaknesses, 
developing a strategic plan for entering 
non-defense markets, and implement- 
ing the changes necessary to compete 
successfully in these markets. Projects 
that targeted finns early in the conver- 
sion process spent substantial amounts 
of staff time and project resources as- 
sisting management in conducting an 
objective assessment of their strengths 
and weaknesses and developing a stra- 
tegic plan for conversion prior to work- 
force retraining. For these projects, 
workforce training sometimes grew out 
of tlie assessment process, when work- 
ers were asked to participate in assess- 
ing the strengths and weaknesses of 
their individual work units. 

Projects that focused on improving 
worker skills often emphasized the im- 
portance of the skills needed for high 



performance workplaces. These skills 
include teamwork, communication, 
problem-solving, continuous improve- 
ment skills, process analysis and statis- 
tical process control. While these skills 
were perceived in all ^isrojects as being 
key to successful firm performance in 
commercial markets, projects VrCre 
most successful: 

s If workforce training was closely 
linked to furthering specific conver- 
sion goals at the firm level. 

■ If worker representati /cs had a voice 
in the design and oversight of train- 
ing. 

■ If there were structured opportum- 
ties for workers to practice their new 
skills in the workplace during and 
after training. 

■ If the firm had identified measurable 
indicators of success at the firm or 
work-unit level 

a If firms were given the autonomy 
they needed to choose a service plan 
that was appropriate, as long as the 
quality of the providers was moni- 
tored by the project administrator. 

It is too early to draw conclusions 
about whether firms were able to avert 
layoffs as a result of the assistance t - icy 
received. However, several of the par- 
ticipating firms were able to document 
improvements in productivity and cost- 
effectiveness measures and/or avoid an- 
ticipated layoffs during the first phase 
of ^e demonstration. 

Increasing Worker Mobility 

Projects 

Nine projects are attempting to pro- 
mote increased worker mobility for in- 
dividuals dislocated as a result of lay- 
offs among defense industry workers, 
military service personnel, and/or civil- 
ian Department of Defense employees 
at military facilities. Figure 2 summa- 
rizes the key features of these projects. 

The worker mobility projects fall 
into three rather distinct categories: (1) 
those that seek to reemploy participants 
quickly without intensive retraining; 

(2) those that seek to prepare partici- 
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Internatioiui] Association 
of Mxchinisto and Aero- 
space Workers 0AM) Con- 
version Demonstration 
lAM Lodge 727 
Los Angeles, CaIiforn?a 



Assist defense-dependent 
firms to become more 
competitive 
Assist in the reemploy- 
ment of dislocated de- 
fense workers 



small to medium-sized 
firms in Los Angeies area 



Provide consulting servic- 
es to assist in conversion 
planning 

Provide HPWO and occu- 
pational skills training 
^Develop and provide 
training to build electric 
car components 

Develop Job opportunities 
for participants 



Long island Defense 
Oivercification Project 
New York State Department 
of Economic Development 
New York, New York 


? Assist defense-dependent 
flmis to t>8Gome more 
competitive by promoting 
HPWC principles 


« d small to medium-sized 
firms in Long Island area 


3 Assess firms’ strengths 
and weaknesses 
* Provide HPWO skills 
training 


Management Assistance 
and Technology Transfer 
Program 

St. Lotiis County Economic 
. Council 

St. Louis, Missouri 


■ Fadritate development 
and implementation of 
commercial conversion 
plans for defonse-dopen- 
dent manufacturing firms 


• 20 smaii to rtiedium-sized 
firms in St. Louis area 


a Support assessment of 
workforce skills and pro- 
duction systems 
■ Support strategic planning 
B Support occupational and 
HPWO skills for workers 


Massachusetts Strategic 
Skills Program 
Massachusetts Industrial 
Senrices Program 
Boston, Massachusetts 


B Assist defense-dependent 
firms to become more 
competitive 


■ 12 small to medium-sized 
firms in Massachusetts 
area 


■ Occupational skills 
training 

» Other skills training 
(HPWO, team and com- 
munication skills, TQM, 
process analysis) 


San Diego County Defense 
Conversion Adjustment 
Demonstration 
San Diego Consortium end 
Private industry Council 
San Diego, California 


■ Assess business needs 

• Disseminate information to 
affected businesses 

■ Assist defense workers 
find new Jobs 


« Defense-dependent busi- 
nesses exploring conver- 
sion in San Diego 


m Survey of local business- 
es to assess and address 
affected business needs 
« Conduct Business 
Roundtables to assist de- 
fense dependent firms 
consider conversion op- 
tions 

■ Deliver services to dislo- 
cated workers, Including 
high tech entrepreneurial 
training and TQM skills 
trairiing 








Figure 1 continues 
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Sargent Controls Project 
Pima County Community 
Setvices Department 
Pima County, Arizona 




Assist hi the conversion of 
Sargent Controls, produc- 
er of nuclear submarine 
valves 



Sargent Controls (employ- 
ing about 400) 



■ Provided support to as- 
sess strengths and weak- 
nesses 

■ Provided occupationai, 
technical and other skills 
training to workers 



Minnesota Defense 
Conversion Adjustment 
Demonstration 
Department of Jobs and 
Training 

St. Paul, Minnesota 


B Assist in Increasing the 
competitiveness of Aliiant 
Telesystems, a producer 
of explosive devices 


B Aliiant Techsystems (em- 
ploying about 4,000) 


B Occupational skills train- 
ing for machinists 
B Workplace baste skills 
training 

B Basic skills enhancement 


The Hummer Project: A 
Dislocation Aversion 
Project 

Workforce Development 
Services 

South Bend, Indiana 


■ Assist in Increasing the 
conversion, stabilization of 
AM General, producer of 
an all-terrain military vehi- 
de. 


B AM General (employing 
1 ,500 workers) and sever- 
al supplier firms 


B Consulting services to 
support HPWO principles 
(AM General only) 

■ Workforce training on 
communications, team- 
building and process 
analysis (AM General and 
nine suppliers) 


Workforce Protection 
Program 

Rhode Island Port Authority 
and Economic Development 
Corporation 

Providence, Rhode Island 


B Assist in increasing the 
competitiveness of small 
defense-dependent firms 


H 20 small to medlum-sizad 
defense firms In Rhode Is- 
land 


B Occupational and techni- 
cal skills training 
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Figure .2 "■ ■■ Art Pyejy^^^ 



Philadelphia Naval Basa 
and Shipyard Complex 
Planning Project 

Pennsylvania Department of 
Labor and Industry 
Philadelphia, Pennsylvania 



Plan and coordinate a re- 
sponse to the drawdown 
of ths^ Philadelphia Naval 
Base, scheduled to be 
complete h> early 1996 



Several thousand at-risk 
and dislocated base work- 
ers 



Idervtify and review strate- 
gies to assist affected 
workers 

Create a database con- 
taining skills and charac- 
teristics of workers and 
needs of businesses 
Develop plans for an on- 
base transition center 



-^1 



CharSdston Naval Complex 
Community Planning 
Project 

Charleston County 
Employment and 
Training Administration 
Charleston, South Carolina 



Plan and coordinate a re- 
sponse to the dislocations 
caused by the drawdown 
of the Charleston Naval 
Complex, scheduled to be 
complete In 1996. 



A small number of dislo- 
cated base workers to 
participate In pilot training 
programs 



Produce an economic 
profile of the Charleston 
metropolitan area 
Develop a coalition be- 
tween economic develop- 
ment entitles, educational 
institutions, and the Job 
training and placement 
community 

Develop a plan for a **one- 
stop shop” 



International Aasociation 
of M&chinltla and Aero- 
space Workers (lAM) Con- 
version Demonstration 
1AM Lodge 727 
Los Angeles, California 



Assist defense-dependent 
firms to become more 
competitive 

Assist In the reemploy- 
ment of dislocated de- 
fense workers 



Dislocated defense indus- 
try production workers with 
experience with composite 
materials 



» Provide consulting servic- 
es to assist in conversion 
planning 

■ Provide HP WO and occu- 
pational skills training to 
workers In partidpaling 
firms 

■ Develop and provide 
training to build electric 
car components 

■ Develop job opportunities 
for participants 



San Diego County Defense 
Conversion Adjustment 
Demonstration 
San Diego Consortium and 
Private Industry Council 
San Diego, California 



Assess business needs 
Disseminate information to 
affected businesses 
Assist defense workers 
find new jobs 



Dislocated defense 
workers 



Survey of local business- 
es to assess and address 
affected business needs 
Conduct Business 
Roundtables to assist de- 
fense dependent firms 
consider conversion op- 
tions 

Deliver services to dislo- 
cated workers, including 
high tech entrepreneurial 
training and TQM skills 
training 
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center for Commorcial 
Comp«tftiv«ness 
State University of New York 
Blnghampton, Now York 


* Assist defense workers to 
start up new businesses 


> Dislocated defense work- 
ers with professional or 
ter^nica! skills 


■ Classroom training in self- 
directed teamwork and 
ccmmerciai competitive- 
ness 

■ Support for project teams 
to develop new business- 
es or contract with local 
firms 


Military Certification 
Project: A Worker Mobility 
Project 

UnWerelty of Ctemson 
Clemson, South Carolina 


m Assist military personnel to 
become teachers In South 
Carolina 


■ Separating military officers 


« Assistance In completing 
prerequisites for Clemson 
University’s teacher certi- 
fication program 
> Assist In placing partid- 
pants In paid Internships 


Project Earn: A Worker 
Mobility Project 
McDonnell Douglas 
Aerospace East 
Titusville, Florida 


■ Assist lald-off employees 
from McDonnell Douglas 
to find replacement jobs 


a Production workers and 
managers laid off from Mc- 
Donnell Douglas’s Titus- 
ville facility after cancella- 
tion of Advanced Cruise 
Missile Program 


■ Basic readjustment ser- 
vices, Including assess- 
ment, career counseling 
and job search assistance 
1 Short-term training to up- 
grade skills 


Operation StepOut: A 
Worker Mobility Project 
Arizona Governor's Office 
for Women 
Tempe, Arizona 


■ Assist participants to tran- 
sition to non-defense em- 
ployers 


■ Women dislocated or at 
risk of dislocation from de- 
fense sector 


■ Assessment, career coun- 
seling, Job search assis- 
tance services 
B Seminar on gender Is- 
sues 

• Access to career network- 
ing group 


Aiternativa Fuels Training 
Project: A Worker Mobility 
Project 

Texas Railroad Commission 
DallaS'Fort Worth, Texas 


■ Train and place dislocated 
defense workers In emerg- 
ing high technology occu- 
pations 


■ Workers dislocated from 
Dallas-Fort Worth area de- 
fense contractors 


■ Support development of 
curriculum 

■ Provide skills training 

■ Assist In certification pro- 
cess 

■ Assist in placement of 
participants 
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pants for new careers in “niche” occu- 
pations (e.g., as teachers, alternative 
fuel technicians for public vehicle 
fleets, or production workers using 
composite materials); and (3) those that 
seek to support would-be entrepreneurs 
in starting new businesses or joint ven- 
tures in high-technology fields using 
skills an 44 )rocesses developed in the 
defense industry. 

Findings 

The projects providing basic read- 
justment services and short-term skills 
enhancement training are rather disap- 
pointing. Few of these projects identi- 
fied new or innovative models of basic 
readjustment services tailored to the 
needs of dislocated defense workers. 
Because project planners in several 
projects had misjudged local labor 
market conditions, the limited services 
offered by these projects were often in- 
sufficient to meet the reemployment 
needs of project participants. Projects 
struggled to adapt or refine services af- 
ter project start-up to correct these 
shortcomings. In addition, projects in 
this category that were not closely co- 
ordinated with local JTPA systems ran 
the risk of duplicating the services 
available from EDWAA or competing 
with the EDWAA system for clients or 
continuation funds. 

The outcomes achieved by the 
projects emphasizing basic readjust- 
ment services were mixed. Although 
most projects appear to be meeting the 
placement rates specified in their pro- 
posals, the placements sometimes took 
longer than expected, were not in a 
training-related field, or were not at the 
desired wage level. 

The ^ro]ec\s preparing dislocated 
defense workers for new careers identi- 
fied cheers that they thought would be 
attractive to and appropriate for groups 
of dislocated defense workers. Using 
project partners with close organiza- 
tional linkages to the targeted occupa- 
tions or industries, they succeeded in 
developing high quality training pro- 
grams in those fields* However, these 



projects have found it very difficult and 
time consuming to recruit appropriate 
participants to match to the available 
services. In addition, projects trying to 
place participants in emerging indus- 
tries have found that the new jobs have 
not always been available when they 
were needed. It is too early to say 
whether these projects are helping par- 
ticipants find high quality jobs at the 
conclusion of training. 

The projects supporting new busi- 
ness start-ups or joint ventures with ex- 
isting firms are testing how high tech- 
nology start-up firms can be used to 
stimulate economic growth by creating 
new jobs in the local economy. Both 
Round 1 projects in this category de- 
veloped highly innovative and ambi- 
tious designs using linkages with exist- 
ing businesses in innovative ways. One 
project appears to be particularly effec- 
tive in achieving positive outcomes for 
participants, perhaps because it selected 
participants who already had strong 
business concepts and emphasized the 
“nuts and bolts” skills needed to 
achieve a successful business startup. 

Conclusion 

Like any major experiment, the 
DCA Demonstration has — even at this 
early stage — shown some successes and 
some failures. When the Department 
of Labor requested proposals for these 
grants tliree years ago, it deliberately 
invited applicants to “break the mold.” 
Project designers responded by taking 
risks in setting goals, forming partner- 
ships, selecting target groups, design- 
ing interventions, administering servic- 
es, and monitoring progress. 

Risk-taking leads to mistakes, and 
this demonstration includes its share of 
mistakes. But risk-taking also leads to 
new knowledge, new models, new les- 
sons. The DCA Demonstration is suc- 
ceeding in providing useful lessons on 
howto support economic conversion, 
whether or not the individual projects 
succeed in accomplishing each of their 
objectives. 



Mary G. Visher is Principal Ana- 
lyst at Berkeley Planning Associates 
OBPA) and project director for the 
Evaluation of the Defense Conversion 
Adjustment Demonstration. Since re- 
ceiving her doctorate in labor market 
sociology in 1984 from the University 
of Wisconsin-Madison, she has been 
active in policy analysis and program 
evaluation. Her area of specialization 
over the past ten years has been in the 
field of employment and training. She 
has directed or been involved with nu- 
merous U.S. Department of Labor stud- 
ies. 

Deborah Kogan is Senior Social 
Scientist at Social Policy Research As- 
sociates (SPR) and co-principal investi- 
gator of the Evaluation of the Defense 
Conversion Adjustment Demonstration. 
She has played a key role in a number 
of national evaluations of federal em- 
ployment and training programs spon- 
sored by the U.S. Department of Labor, 
including a recent evaluation of the 
EDWAA program. She is also direct- 
ing a study for the U.S. Department of 
Agriculture of a five-state demonstra- 
tion project to test the feasibility of ap- 
plying Food Stamp Employment and 
Training Program regulations to the 
JOBS program for AFDC recipients. 
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Most economists agree with the 
Clinton Administration's assessment 
that economic growth has resumed In 
the 1 990s but at a slower pace than in 
previous upswings. The International 
Monetary Fund supports this conclu- 
sion in terms of global economic condi- 
tions, predicting a gradual expansion 
from 3.8% in 1994 to 4.2% in 1996. The 
Mexican peso crisis and the falling U.S. 
dollar have led to cautions, however. 
But new trade agreements such as 
GATT have been considered positives 
in this picture of the future. 

In fact moderate growth is viewed by 
some economists as having real virtue. 
Inflation is remaining low and forecast- 
ers propose that a 3% growth rate will 
lift Americans’ after-tax income in real 
terms and reduce unemployment to an 
acceptable 6%. However, they ac- 
knowledge that military downsizing and 
continued recessions abroad could 
change these predictions. And it is sig- 
nificant that although corporate Ameri- 
ca spent an enormous amount on new 
equipment In the 1990s in order to be- 
come more efficient and profitable, little 
job growth resulted. Only 2.3% was 
spent on expanding businesses. A 
large portion of the increase in employ- 
ment in the 1990s has been related to 
the manufacturing, installing or pro- 
gramming of the machinery and com- 



puters companies have been buying In 
record numbers, but not all of these 
workers were permanently retained. 
Expansion has been less profitable in 
the context of International competition. 

On the side of a generally positive 
economic vision for the U.S. is the U.S. 
Census Bureau’s 1994 report indicating 
that Americans were living longer, 
smoking less, spending more money on 
educational materials, owning fewer 
guns, divorcing less, and staying mar- 
ried longer, infant mortality had 
dropped. Per capita Income measured 
in constant 1987 dollars had increased 
Disposable income had risen. The level 
of educational attainment had in- 
creased. But there was a dark side as 
well. Average hourly earnings mea- 
sured in constant 1982 dollars had de- 
clined between 1980 to 1993. Median 
scores on Scholastic Assessment Tests 
had plummeted. The increase in Ameri- 
cans’ expenditures on video and audio 
equipment and personal computers had 
dwaded their expenditures on educa- 
tion. 

Meanwhile, international competition 
had grown dramatically, particularly be- 
tween the U.S., Europe and the Pacific 
Rim. Studies of economic performance 
in the early 1990s showed clearly that 
American manufacturers in general and 
in a wide range of industries, including 
many high technology industries, were 
losing ground to foreign competitors. 




Our share of world imports climbed; our 
share of world exports declined. At the 
same time, over the past two decades, 
the living standards of more than 80% 
of American families had dropped. 

An important lesson about the new 
economic environment has been that 
industries focusing on intense knowl- 
edge bases, and industries achieving 
significant "economies of scale," have 
had a longer-term impact than others 
on technology performance In other 
economic sectors. Governments that 
have targeted such high-technology 
sectors for special support and devel- 
opment assistance have encouraged 
economic progress. Governments that 
have over-shielded major corporations 
from competition have created econom- 
ic disincentives. In fast-growing econo- 
mies, government and industry have 
worked as collaborative partners In de- 
veloping critical industries facing for- 
eign domination. In nations with the 
best records of industnai development, 
government, labor and management 
pursue manufacturing excellence to- 
gether, using a variety of policies and 
actions. They ensure that a high quality 
workforce is available through a com- 
petent, accountable education and 
training system. And they give serious 
attention and energy to the readjust- 
ment and reemployment of workers ad- 
versely affected by economic change. 
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Robert B. Reich 
Secretary of Labor 

Even tliough it has been a long time 
since the picture has been as bright as it 
is now for the average American work- 
er, the experience of the “average” 
worker is becoming less and less rele- 
vant. Some workers are surging ahead, 
others are treading water, and still otli- 
ers are sinking fast — in the same 
economy, at the same time. The state of 
the American worlforce, in short, is di- 
vided. 

In the late 1960s, as my generation 
was joining the workforce, the vast ma- 
jority of Americans were middle class, 
in reality as well as in perception. Their 
status and prospects differed only mod- 
erately from the average. In an aston- 
ishingly short time, the old middle class 
has splintered. The erosion of a sense 
of shared prospects poses what may be 
our nation’s most critical challenge of 
the post-Cold War era. Reversing this 
erosion, giving all Americans a reason 
to believe once more tliat hard work 
will lead to a better life, must become a 
central policy objective. 

Broad trends that have converged 
and accelerated since the middle 1970s 
have split the old middle class into 
three groups: an underclass largely 
trapped in central cities, increasing!'^ 
isolated from the core economy; an 
overclass of those who are positioned 
to profitably ride the waves of change; 
and in between these the largest group, 
an anxious class, most of whom hold 
jobs but who are justifiably uneasy 
about their own standing and fearful for 
their children’s futures. Despite the 
progress of the past year, this division 
still casts a shadow over the state of the 
American workforce. We can describe 
this picture in greater detail with the 
help of new data, much of it recently 
compiled by the Bureau of Labor Sta- 
tistics. 




Basic Causes 

The fundamental fault line running 
through today’s workforce is based on 
education and skills. Well-educated 
and skilled workers are prospering. 
Those whose skills are out of date or 
out of sync with industrial change anx- 
iously contemplate their prospects. 
Those without education or skills drift 
further and further away from the eco- 
nomic mainstream. The notion that we 
are creating a bounty of bad jobs is a 
myth. Most new jobs are good jobs. 

The problem is that jobs that remain 
for workers without sidlls or with the 
wrong skills are beccming grimmer. 

Skills have always mattered, but 
they have not always such potent 
determinants of economic destiny. As 
recently as 1979, a male college gradu- 
ate earned 49% more than a similar 
man with only a high school diplo- 
ma — a sizeable difference, to be sure, 
but not too large for the two to share 
the label “middle class.” By 1992, 
however, the average male college 
graduate was earning 83% more than 
his high school graduate counterpart, 
and the notion of common prospects 
had faded considerably. The picture for 
women is similar, if slightly less stark. 
At every level of education and training 
the pattern holds: the higher the skill 
level, the higher the earnings. And the 
gap has been growing. 

Not only the wages and benefits that 
workers can command, but also their 
chances for holding a job at all, are di- 
vided along lines linked to skills. This 
gap, too, is widening over time. In the 
1970s, the average unemployment rate 
for people who had not completed high 
school was 7%. By the 1980s, this rate 
averaged 11%, and in 1993 it was over 
12%, By contrast, the unemployment 
rate for workers with a college degree 
or better has held fairly steady at 
around 3%, Over the most recent ten- 
year period for which data are available 



(1983 to 1993) the number of jobs in 
sectors that typically require higher lev- 
els of education has grown by an annu- 
al average of 2.8% while job growtli in 
sectors requiring less education has 
been only 1%, This shift in favor of 
skills shows up not just in the U.S. but 
in other advanced countries. 

In a seeming paradox of today’s 
economic news, financial markets fret 
that unemployment is too low to con- 
tain inflation, even while eight million 
willing American workers remain job- 
less. Part of the answer to this apparent 
contradiction is that markets for highly 
skilled labor are becoming tight in 
many parts of the economy, creating 
the conditions that can kindle inflation 
worries. But millions of less-skilled 
workers remain idle or underemployed. 
This wasted workforce is walled off by 
skill barriers from the leading edges of 
the economy. The best way to expand 
the economy’s capacity and lower the 
level of unemployment needed to bridle 
inflation is to dismantle these walls by 
preparing underutilized workers for 
more productive work. 

What lies behind these widening 
disparities within the workforce? Man- 
ufacturing jobs were once the gateway 
to the middle class, even for workers 
who started off without high-level 
skills. While it is a myth thaC»intema- 
tional trade has robbed America of its 
manufacturing industries, technological 
changes have diminished the role of la- 
bor, especially unskilled labor, in the 
modem factory. And global trade and 
investment surely have hastenW these 
changes. Even within manufacturing 
industries, a rising share of value is 
added before the assembly line begins, 
and after goods are produced. 

Labor unions have long helped 
shore up wages and benefits even for' 
workers without high-level skills. But 
today only 1 1% of the private sector 
workforce is represented by a union. A 
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revitalization of the labor movement 
would help reverse the erosion of the 
middle class. 

The most striking change in the 
workplace has been the brash arrival of 
the computer. In 1984, about 25% of 
American workers used computers on 
the job. Last year almost 47% did so. 

And contrary to the belief that comput- 
er-literate youth are running circles 
around their technophobic elders, 
workers between ages 40 and 54 com- 
prise the group most likely to work 
with computers. Even workplace com- 
munication has been transformed, as 
one in ten workers now uses electronic 
mail to communicate with colleagues 
around the comer or around tlie world. 

But the computer revolution has 
deepened the division of the American 
worlforce. Two-tliirds of college grad- 
uates use computers at work, but only 
one-third of high school graduates, and 
fewer than one in ten high school drop- 
outs. The vast majority of managerial, 
technical, and professional workers use 
computers. But people in lower-pay- 
ing, lower-skill occupations use them 
far less frequently. The information 
highway promises to speed some peo- 
ple t'> desirable destinations, but it may 
be leaving others stranded in the high- 
tech version of inner-city ghettos. A re- 
cent study of census data found that 
fully 5% of America’s households lack 
access to a telephone, the basic ticket 
of entry to the information web. Other 
data show that minority children are 
less likely to use computers at school 
or at home. As personal computers be- 
come standard equipment for learning 
at home, children who are discoimected 
from the system will fall further and 
further behind. 

Ethnic Divisions in Rebuilding 
the Middle Class 

Despite the issues cited, long-term 
data affirm the potential for building a 
new middle class. The skill-based divi- 
sions of today’s workforce are in some 
ways more readily overcome than the 
divisions based on race and gender that 
have haunted America throughout our 
history. 



However, the road to opportunity is 
often much rockier for people of color. 
Last month the national unemployment 
rate for black Americans was over 
11%, more than double the rate for 
white Americans. Today black men 
hold only three out of every one hun- 
dred managerial, professional, and 
technical jobs. The median income for 
black males working full-time and full- 
year in 1992 was $22,400, just 72% of 
the median income for comparable 
white males. Hispanic Americans seek- 
ing to join the middle class have con- 
fronted similar obstacles. Their unem- 
ployment rate tops 10%, and their 
eaiTiings have been steadily'croding. 

And Hispanic workers are significantly 
less likely than their white counterparts 
to receive health insurance on the job. 

Closing these gaps requires a long, 
painful process of national growth and 
healing to which we must remain com- 
mitted. Virtually every willing worker 
can expand his or her skills. Informa- 
tion technology itself promises to vast- 
ly increase the productivity of learning 
as it makes top-flight teaching tools 
more widely available. We already see 
emerging around us examples of so- 
phisticated yet accessible work that can 
form the platform for a new middle 
class. Some of tlie most notable job 
growth has occurred among technicians 
who defy the traditional categories of 
the old economy. Their ranks are pre- 
dicted to grow by nearly 40% over the 
next decade. Data released recently 
show that the most rapid job growth is 
in high-paying occupations, even with- 
in traditionally iow-paying industries. 
This hints at the proliferation of new 
kinds of middle-class jobs throughout 
the economy. 

The technician jobs that will sustain 
the core of the new middle class usual- 
ly require some education beyond high 
school, but they do not always demand 
a four-year college degree. Degrees 
from community colleges are paying 
off, and their enrollments are rising. 
Men with community college degrees 
earn 26% more, on average, than men 
with only a high school diploma. Wom- 



en who have graduated from communi- 
ty colleges earn 33% more than women 
with only a high school diploma. 

Middle Class Revitalization 

Skills clearly matter, and they can be 
learned. We have to combat the forces 
dividing America’s workers with an ar- 
mory of new approaches to lifelong 
learning. An additional 130,000 chil- 
dren each year can now be made ready 
to leam at school through Head Start. 
School systems throughout America 
have millions of dollars in new incen- 
tives to improve their performance. 
During the summer of 1994, some 
120,000 disadvantaged youth combined 
jobs with classroom instruction. Oyer 
the next six years, almost half a million 
young Americans will be entering 
youth apprenticeships during the last 
two years of high school, many of them 
receiving special skill training beyond 
high school. 

Starting in the fall of 1994,20,000 
young people will enter National Ser- 
vice, earning money that they can apply 
to a college education. The three and 
one-half million people who take out 
education loans each year now have the 
option of repaying their loans as a per- 
centage of future income. Fifteen mil- 
lion working families with modest in- 
comes are receiving tax relief. We have 
begun transforming the old unemploy- 
ment insurance system into a reemploy- 
ment system, insuring that in 1994 
alone an additional 150,000 Americans 
who have lost their jobs will get the 
skills or the job search help they need 
to find new ones. We must also deliver 
on health security, or our mission of 
turning the anxious class into a new, 
more secure, more productive middle 
class cannot be completed. 

American business has a crucial role 
to play in building a new middle class. 
Skills learned on the job, or in a work- 
related setting, tend to be especially 
well-tailored to the requirements of the 
workplace. New data on work-related 
training show that the impact of such 
training is of the same magnitude as 
more traditional schooling. Men and 
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women who graduate only from high 
school, but who have received work-re- 
lated training, earn more than people 
who have attended some college but 
who have not received any additional 
training, and almost as much as college 
graduates who lack additional work- 
based training. 

Yet most companies are not yet do- 
ing enough training, and what training 
they do provide is not beiiig directed to 
the workers who most need it. Among 
young college graduates, about 35% 
now receive work-related training. That 
is nearly douLle the rate for high school 
graduates and more than four times the 
rate for high school dropouts. Tlie 
workers most likely to receive training 
are tvhite, male, well-educated, and 
working in high-paying occupations. 
This imbalance serves only to harden 
the divisions within the workforce. 

The payoff to work-based training, 
and the inadequacy and uneven distri- 
bution of such training, highlights the 
need for a new social compact among 
American workers, business, and gov- 
ernment. Businesses need to do their 
part in this new compact by bringing 



all workers along on the route to pros- 
perity, investing aggressively in their 
skills ^d making them partners in pro- 
ductivity. This new compact is an im- 
perative not only of corporate citizen- 
ship but of firms’ own long-term 
interests. 

Achieving A Better Future 

A constant theme of American histo- 
ry has been the challenge of forging 
unity out of diversity. We are at an im- 
portant point once again in meeting this 
challenge. This time the deepest divi- 
sions are not based as much on race, 
national origin, or geography. They are 
based on the ability of individuals to 
make their way in an increasingly tur- 
bulent economy. The overclass is doing 
fine, but questioning its connection to 
the rest of America. The underclass is 
isolated in marginal enclaves walled off 
from hope. The anxious middle class is 
being pulled and stretched by the need 
to work two or more jobs to keep a 
family solvent, by uneasiness about 
health care, by the specter that today’s 
job will disappear tomorrow, and by 
fears that their children will be denied 
the opportunity for a better life. 



If unchecked, these divisions can 
coiTode our society. Unlike the citizens 
of most other nations, Americans have 
always been bound together less by a 
shared past than by shared dreams of a 
better future. If we lose that common 
futme, we lose the glue that holds our 
nation together. Nothing is more vital 
to fulfilling our nation’s defining 
promise than preparing ail Americans 
for meaningful, productive working 
lives. In this century’s waning years, in 
the hopeful, fearful confusion of the 
Cold War’s end, our most important 
mission is to restore hope to the anx- 
ious class and lift despair from the un- 
derclass, and to affirm the conviction 
that the American dream of broadly 
shared middle class prosperity still en- 
dures. 



Editor’s Note, 



The commentary above is excerpted 
from Secretary Reich’s 1994 Labor Day 
speech delivered at the Center for Na- 
tional Policy in Washington, D.C. 
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In this Issue of Evaluation Forum we 
are privileged to feature our first inter- 
view with a respected European expert. 
This extensive interview addresses 
some of the fundamental economic 
challenges facing ail industrialized na- 
tions, and highlights the situation for 
countries In transition to political de- 



mocracy and a market economy. This is 
a uniquely informative macro-perspec- 
tive on economic restructuring and Its 
implications. 

In addition we are pleased to include 
our first interview with representatives 
of management and labor in a major 
U.S. multinational corporation — the 
aerospace giant, the Boeing Company. 



Faced with the necessity of unexpected 
layoffs in the 1990s, the company and 
its unions, working with federal and 
state agencies, have developed a mod- 
el reemployment program to assist dis- 
located Boeing workers in a period of 
adjustment to economic change and 
the internationalization of markets. 



An Interview with Salvatore Zecchini 



' Editor’s intr^^ ; 



Given the emphasis in this issue of 
Evalustion Forum on industriai econo- 
mies and their efforts to survive in a 
new competitive global marketplace, 
we are pleased to have an interview 
with Salvatore Zecchini, the Assistant 
Secretary-General of a strategically im- 
portant international organization, the 
Organization for Economic Cooperation 
and Development (OECD) in Paris, 
France. Established in 1 960, the 
OECD’s mission has been to promote 
economic growth, sustainable employ- 
ment, and a rising standard of living in 
member nations. Its membership in- 
cludes all the major advanced Industrial 
nations, currently twenty-four countries. 

Mr. Zecchini is also Director of 
OECD's Centre for Cooperation with 
Economies in Transition, which offers 
assistance to Central and Eastern Eu- 



ropean nations, and the independent 
republics of the former Soviet Union, in 
their transition to market-based econo- 
mies. 

The Assistant Secretary-General re- 
ceived a Ph.D. in economics from the 
Wharton School of Finance in the Unit- 
ed States, and is a former professor of 
economics in Italy. He subsequently 
served as economist for the Economic 
Research Department of Banca d'ltalia. 
From 1984 through 1989 he was Exec- 
utive Director of the International Mone- 
tary Fund. In 1989 he was named Spe- 
cial Counsellor for Economic Affairs at 
OECD, and began his tenure as Assis- 
tant Secretary-General and Director of 
the Centre in 1990. 

Mr. Zecchini has had an Impressive 
career, serving as economic advisor to 
the Prime Minister of Italy, the Minister 
of Foreign Affairs, the Minister of the 



Treasury, the Minister for Agriculture, 
and the Minister for the Coordination of 
Community Policies. He represented 
the Banca d’ltalia in international bod- 
ies addressing economic Issues in Eu- 
rope, and participated in the technical 
meetings of the Deputies of the Group 
of Ten. He was also a member of Italy’s 
delegation to the two technical negotia- 
tions for the establishment of the Euro- 
pean Monetary System and European 
budget reform. 

In addition, Mr. Zecchini has pub- 
lished numerous studies on corporate 
finance, European financial policies, 
the consequences of Italy’s member- 
ship in the European Union, interna- 
tional economics, monetary and finance 
Issues, and the transition from central 
planning to market economies. 



Question: For Central and Eastern 
Europe, the transition to a market econ- 
omy clearly represents a diificult his- 
torical passage. This is not unexpected 
given the magnitude of the economic, 
social and cultural changes occurring in 
these societies. How has the Organiza- 
tion for Economic Cooperation and 
Development (OECD) addressed the 
challenges involved in this transition? 

Mr. Zecchini: In 1990, the OECD 
Council decided to create the Centre 
for Co-operation with Economies in 
Transition (CCET) to launch and man- 



age a wide-ranging program of dia- 
logue and cooperation with the transi- 
tion countries. 'The goal of the OECD’s 
cooperation has been to contribute to- 
wards the development of pluralist de- 
mocracy and market-oriented econo- 
mies by mobilizing the experience and 
expertise of the OECD secretariat and 
Member Countries. The cooperation 
takes a variety of forms, including 
1) provision of advice on tlie design, 
implementation and monitoring of ap- 
propriate policies, 2) policy dialogue 
with the Organization and its Member 
Countries on the main economic issues 



related to the transformation of the eco- 
nomic system, and the integration of 
these reforming countries in the world 
economy, and 3) training activities. 

With regard to the subject of this is- 
sue of Evaluation Forum, it is impor- 
tant to note that from its inception the 
CeST has given high priority to the 
human resource issues related to struc-' 
tural change in the transition countries. 
In particular, I am referring to educa- 
tion, social and labor market issues. In 
the framework of the CCET’s work 
program for these areas, the OECD’s 
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Directorate for Education^ Employ* 
ment, Labour and Social Affairs holds 
responsibility for provision of technical 
assistance. The work program is fo- 
cused primarily on 1) improved moni- 
toring of educational lator market and 
social developments, and 2) design and 
implementation of an appropriate poli- 
cy strategy that aims at helping to es- 
tablish well-functioning labor markets, 
social safety nets and educational sys- 
tems. 

Specific reviews of education, labor 
market and social policy are the main 
instruments used to pursue these goals. 
In cooperation with the corresponding 
host country Ministries, these reviews 
survey and analyze the full range of 
available information on the recent de- 
velopments in a sector. Drawing on this 
information, the current policy frame- 
work and institutions are examined 
with a view to offering a critique of the 
situation, highlighting positive develop- 
ments while offering suggestions where 
performance falls short. To date, these 
reviews have focused on the four transi- 
tion countries participating in the 
OECD’s Partners in Transition Pro- 
gram: the Czech Republic, Hungary, 
Poland, and the Slovak Republic. This 
year we will add to the list, as the first 
education review of the Russian Feder- 
ation is undertaken. 

Besides the review process, the on- 
going series of activities targets a range 
of technical and policy issues using a 
variety of approaches, including coun- 
try-specific case studies, expert mis- 
sions and seminars, and international 
conferences and workshops. The imple- 
mentation of the market-oriented 
recommendations drawn from these ini- 
tiatives is supported through training 
activities designed to reinforce the 
working capacity of host country insti- 
tutions. The OECD is also contributing 
important statistical tools through the 
development of education and labor 
statistical databases that provide inter- 
nationally comparable data series for 
several transition countries. 

Question: In 1991, the OECD orga- 
nized jointly with the International La- 
bor Organization (ILO) a High-Level 



Conference on Labour and Social Im- 
plications of Structural Change in Cen- 
tral and Eastern Europe. The proceed- 
ings were subsequently published. Did 
this contribute a foundation for future 
OECD technical cooperation? 

Mr. Zecchini: The High-Level Con- 
ference was a concrete and early mani- 
festation of our concern for labor mar- 
ket and social issues in the transition 
countries. The main conclusions of this 
conference remain relevant to the situa- 
tion today. Broadly speaking, tliree 
points are of particular relevance: 

■ ' First, during the transition an appro- 

priate set of human resource policies . 
can work to help address major 
social and labor market problems re- 
lated to structuial change — these 
policies can facilitate a smooth func- 
tioning of the labor market while 
providing the foundation for the so- 
cial safety net, and promotion of 
the social consensus for reform. 

■ Secondly, these policies can promote 
longer-term economic development 
through enhancement of human cap- 
ital, and promotion of cooperative 
industrial systems. 

■ Thirdly, they can strengthen plural- 
istic democracy by improving the 
representation of the interests of the 
social partners. 

The conference proceedings were pub- 
lished by the OECD in a volume enti- 
tled Structural Change in Central and 
Eastern Europe: Labour Market and 
Social Policy Implications. The first 
chapter of this book addresses key is- 
sues in the transition that remain cen- 
tral even as the transition has advanced. 
These include 1) sluggish growth in 
these economies, 2) privatization and 
enterprise restructuring, 3) a rise in un- 
employment and labor marginalization, 

4) increased poverty, 5) widening eco- 
nomic disparities between social 
groups and between regions, and 6) in- 
ternational migration. 

Although much has happened since 
the time of the conference, the issues it 
raised proved to be right on target. In 



some cases we are still struggling to 
solve them. Fortunately, there are many 
encouraging developments in terms of 
institutional and economic reform. The 
leading economies in transition have 
turned the comer and are once more ex- 
periencing economic grovrth. 

Question: High unemployment has 
become a troubling feature of the labor 
market in most transition countries. 
Could you comment on unemployment 
trends and the imderiying dynamics? 

Mr. Zecchini: The first phases of 
transition to a market economy in the 
Central and Eastern European countries 
(CEECs) and NIS have brought about 
major changes in the economic and so- 
cial fabric of each country, including 
widespread employment adjustments 
and, in most, a rapid increase in open 
unemployment. Although these adjust- 
ments are an inevitable consequence of 
the process of economic transforma- 
tion, they are producing growing hard- 
ship for tine population as a whole, and 
for certain vulnerable social groups in 
particular. Furthermore, imemployment 
and poverty have created pressures on 
state budgets due to increased outlays 
for unemployment benefits and social 
assistance. They are thus creating new 
constraints for the disinflationary poli- 
cy strategy as well as for the reform of 
public expenditures. 

In most of the CEECs, unemploy- 
ment materialized in a wave, following 
the institution of market-oriented re- 
forms. Already at the end of 1991 , un- 
employment rates were close to 10% 

(or even above) in Bulgaria, Hungary, 
Poland and Slovakia. In these coun- 
tries, unemployment rates continued to 
grow at a fast pace during 1992. The 
Czech Republic, which was the subject 
of a recent OECD labor market review, 
is a significant exception to this pat- 
tern. After initially experiencing a rise 
in unemployment (although at a lower 
pace than most CEECs), there was a 
significant decline in the number of job 
seekers in 1992, and a stabilization in 
tlie unemployment rate thereafter 
(around 3%). 

The Russian Federation too has 
shown distinctive labor market pat- 
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terns. In general, employment in Russia 
has been declining much more slowly 
than output. In the three years since 
1991, employment is estimated to have 
dropped by roughly 4 million to under 
70 million. Compared to most of the 
CEECs, unemployment remains fairly 
low, with estimates of the unemploy- 
ment rate ranging from roughly 2% 

(based on administrative data on the 
registered unemployed) to about 6.5% 
(based on estimated Labour Force Sur- 
vey updates) in the fourth quarter of 
1994. As of October 1994, the popula- 
tion officially registered as being “out 
of employment'* was 1.75 million. Re- 
cently unemployment has begun to rise 
and is likely to continue to do so, espe- 
cially if the traf)|itLon process gains 
momentiuii. 

Unemployment rates by themselves, 
however, offer only a partial picture of 
the labor market slack during the tran- 
sition process. Sizeable flows from em- 
ployment to out-of-the-labor force have 
occurred. This is especially true where 
extensive use of soft dis-employment 
measures — such as early retirement 
and “easier" access to various kinds of 
disability benefits — was made in the 
early stages of the transition, and where 
most working pensioners were pushed 
out of the labor market. Flows to inac- 
tive status (rather than into unemploy- 
ment) have also occurred among indi- 
viduals of working age, especially in 
the Czech Republic and Hungary. In 
the latter, for example, the participation 
rate for the working age population 
dropped by some three percentage 
points during 1993. In Russia, there has 
been a substantial growth in underem- 
ployment and wage anears, as well as a 
continuing decline in labor productivi- 
ty. 

In September 1993, the OECD orga- 
nized a Technical Workshop on “The 
Persistence of Unemployment in Cen- 
tral and Eastern Europe.” Evidence pre- 
sented there suggests that unemploy- 
ment has grown in many cases more as 
a consequence of low rates of outflow 
into jobs, than of unusually high rates 
of inflow into unemploymenL Despite 
the massive employment adjustments in 
most countries of the region, monthly 



inflows into unemployment have been 
relatively contained, even when com- 
pared to those prevailing in low-unem- 
ployment OECD countries. Also, there 
have been significant flows that com- 
pletely by-pass unemployment. Direct 
job-to-job shifts and flows out of the 
labor market have played an important 
role in the reallocation of labor. 

Put another way, unemployment has 
been a rather stagnant pool, especially 
in the early^tages of the transition. In 
most of the transition countries, once a 
worker has lost his or her job ii is very 
difficult to obtain another position. Un- 
der these circumstances, unemployment 
is highly persistent, and in many cases 
the lack of job opportunities results in 
the job seeker leaving the labor market 
altogether instead of being reintegrated 
into a job. 

As is the case in most high-unem- 
ployment OECD countries, the burden 
of unemployment is unevenly spread 
across the different social groups in 
transition countries. It has fallen dis- 
proportunately on young, unskilled 
and older workers, and some ethnic mi- 
norities. Furthermore, even in a context 
of stable or declining numbers of job 
seekers, the average duration of unem- 
ployment has increased dramatically. 
Many long-term unemployed have left 
the labor market. These phenomena are 
signaling the difficulties now encoun- 
tered by certain social groups, which 
should be the focus of more attention 
by labor market and social policy insti- 
tutions. 

The economic and social hardship of 
reforms also has 2 i geographical dimen- 
sion, which was the subject of a Tech- 
nical Workshop organized by the 
OECD and the Institute for Advanced 
Studies in November 1994. In most of 
the transition countries, large urban 
centers have unemployment rates well 
below 10% and inther favorable ratios 
between unemployment and job offers, 
while rural areas and many mono-cul- 
tural industrial sites are suffering from 
unemployment rates above 20% and 
few job openings. Given the rigidity 
and tight supply in the housing market, 
these regional disparities cannot be eas- 



ily overcome by geographical labor 
mobility. Rather they require, at least in 
the short term, specific efforts in the 
backward areas, and a redistribution of 
resources to them from wealthy areas. 

Unemployment has risen and contin- 
ues to grow in some areas. However, 
this must be contrasted with ongoing 
reallocation of labor and some eco- 
nomic restructuring. Many new jobs 
have been created although they are 
somewhat precarious, particularly those 
in small firms and in self-employment. 
Some of the newly created businesses 
are yielding good wages and benefits, 
but many do not and will not. 

Question: What have been the main 
elements of CEEC and NIS human re- 
source policy in the face of economic 
restructuring? 

Mr. Zecchinl: The transition countries 
have been quick to initiate develop- 
ment of human resource policies and 
programs corresponding to the require- 
ments of a market economy. There 
have been significant successes in this 
regard, although further adjustments in 
the new policy framework or policy 
implementation processes will be re- 
quired. Moreover, the task of restruc- 
turing elements carried over from the 
previous system has not been complet- 
ed. 

Labor market policy has been at the 
center of the reform efforts. Early in 
the reform process, transition countries 
enacted new comprehensive employ- 
ment laws which are serving as the ba- 
sis for labor market policy and pro- 
grams. These laws generally affirm the 
rights and responsibilities of people in 
employment matters, including the 
choice of whether to work and of occu- 
pation. In many cases such laws bor- 
rowed from similar statutes of OECD 
Member Countries. Building on these 
employment laws, transition country la- 
bor market policies and programs have 
generally sought to achieve: 

■ Reduction in the level of unemploy- 
ment. 

■ Decreased labor market segmenta- 
tion and improved labor market 
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prospects for vulnerable groups in 
society. 

■ Promotion of occupational and in- 
dustrial mobility, and delivejy of 
basic income support for the unem- 
ployed during limited periods of job 
search. 

Employment laws have provided for the 
establishment of public employment 
services charged with the administra- 
tion of unemployment compensation, 
placement assistance and additional ac- 
tive labor market programs such as 
training and public works. In some cas- 
es, the public employment services 
were established as independent agen- 
cies. The development of these services 
has been the focus of substantial 
amounts of international a^istance, in- 
cluding the technical cooperation activ- 
ities of the OECD. 

Across the transition countries, the 
structure of social policy is still under- 
going substantial restructuring and/or 
development. Witness the fact that sev- 
eral countries have recently introduced 
new social laws or policies for which it 
is still too early to assess the effects. 
Given the wide range of issues, I will 
focus on three aspects of social policy 
that are closely tied to poverty issues: 
pensions, family allowances and social 
assistance. 

In the old system, inefficiencies en- 
sured high demand for labor. Employ- 
ment was virtually guaranteed for those 
who could work, thereby ensuring in- 
come during one’s wortog life, and a 
pension in the event of disability or re- 
tirement. As a result, social assistance 
targeted only a small minority of the 
population, such as the handicapped or 
orphans. 

Today, pensions and family allow- 
ances serve as a primary means for de- 
livering social protection. In reforming 
countries, restructuring of the pension 
system is required to ensure long-term 
viability, particularly in the face of low 
retirement ages and an erosion of the 
value of benefits due to inflation. 

To wmbat low benefit levels, many 
strategies for reform aim to restrict 



pension eligibility while increasing the 
average payment size. Tlie implementa- 
tion of such strategies is fraught with 
IK>liticai risks and consequently does 
not seem feasible over a short period. 
Family allowances vary, and in some 
cases are based on inappropriate per 
capita measures that do not take mto 
account household economies of scale. 
Approaches to the provision of further 
social assistance have varied, depend- 
ing in part on the le\^el of decentraliza-- 
tion in the system. In some cases, the 
lack of national norms has caused a 
wide variation in the availability and 
level of benefits. In the Russian Federa- 
tion, for example, such assistance is 
primarily the responsibility of tlie local 
and regional governments. 

The education policies of the transi- 
tion countries need substantial and ur- 
gent reform as well. As stressed in sev- 
eral studies conducted by the OECD 
during the last three years, there is an 
urgent need for greater coherence be- 
tween labor market and education poli- 
cies. Education reviews carried out by 
the OECD in the former Czech and 
Slovak Republics, and Hungary and 
Poland, have identified the following 
common problems: 

■ The lack of long-term plans for the 
development of higher education, 
and the need to render the system 
more flexible in responding to the 
needs of a market economy. 

■ Problems relating to the capacity of 
educational institutions. 

■ The growing social differentiation, 
and the problems of identifying so- 
cial needs. 

■ The quality of the teaching staff, and 
“brain drain” problems, 

■ The autonomy of institutions, the 
decision process, the legislative 
foundation, aiid the division of com- 
petencies within institutions. 

In all cases, financial resource con * 
straints are proving to be a major con- 
cern. Competition with other govern- 
ment priorities in the face of heavy 



budgetaty pressures is constraining the 
modernization of education. 

Generally, the sj ^tem of training in 
the transition countries placed empha- 
sis on enterprise-based progiams. The 
transition has led to a substantial reduc- 
tion in the number of training places 
available in state-owned enterprises, 
and the private sector has been unable 
so far to provide sufficient opportuni- 
ties for initial atid further education 
training. This comes at a time when 
there is a major need for retraining 
workers who have lost their jobs, or for 
training young entrants into the labor 
market. 

Question: During the 1991 OECD- 
ILO conference, migration issues were 
raised as an area of possible future con- 
cern. How has this issue developed, 
and how do you see it evolving? 

Mr. Zecchini: Despite the severe limi- 
tations imposed by the cenirally- 
planned governments, considerable ex- 
ternal migration flows have been an 
aspect of the socio-economic develop- 
ments of central and eastern European 
countries during the past decades. The 
ongoing transition process has radically 
changed the nature, if not the magni- 
tude, of migration flows. 

Continuing emigration flows are 
likely to result from the labor market 
slack, especially in certain backward 
regions. Cross-border commuting has 
also emerged in regions on the border 
with the West. Evidence presented at a 
recent OECD conference on Regional 
Unemployment in Transition Countries 
suggests that this is directly related to 
the labor market conditions of the re- 
gion of origin, and the existence of for- 
mal agreements between the countries 
of origin and destination, as is the case 
between the Czech Republic and Ger- 
many, 

Official in-migration data suggest 
that there are Increasing flows toward 
transition countries, due also to the re- 
t\m of former residents. However, offi- 
cial data may under-report inflows of 
foreigners in transit tlirough some tran- 
sition countries toward Western Euro- 
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pean countries, as is the case for Po- 
land. The cooperation between transi- 
tion countries and the OECD in the 
area of international migration had al- 
ready started in 1991 in the framework 
of the Continuous Reporting System of 
Migration, This system is planned to 
further contribute lo the improvement 
of information on the dimension of the 
in-migration phenomenon, on one 
hand, and the definition of suitable pol- 
icies to cope with it, on the other. 

Inter-regional migration is also an 
issue of great importance in all transi- 
tion countries. As stressed before, re- 
forms have brought about m^or re- 
gional disparities in the economic and 
labor market conditions of different re- 
gions. indeed, labor migration flows 
seem, to respond to differences in the 
economic conditions of regions. The 
major urban centers, and other regions 
with a diversified production base, 
have experienced consistent in-migra- 
tion of labor in the last period. Howev- 
er, iiiter-regional migration flows have 
not increased in aggregj^te teims in all 
transition countries, due to the major ri- 
gidities in the housing market, and the 
lack of information regarding job op- 
portanitics. 

Question: Each of the transition 
countries has entered the reform pro- 
cess in the context of unique exper- 
iences and conciitions which will re- 
quire varied policy responses. Beyond 
this, however, are tlserc common 
theme? that you have identiiied for en- 
hancing human resource policy? 

Mr. Zecchlnh It is important to un- 
derline the importance of a lesson that 
we have learned in the OECD Member 
Countries. Experience from a wide 
range of countries has shown that 
sound economic policy is the best base 
from which to promote employment. As 
the recent OECD Jobs Study points out, 
a primary component of such a policy 
consists of an appropriate macroeco- 
nomic policy that includes sound pub- 
lic finances, price stability, and promo- 
tion of a sustainable balance of 
payments position. However, a sound 
macroeconomic policy by itself cannot 
guarantee sustained economic growth, 



particularly during the economic transi- 
tion. Economic policy must address a 
broad range of structural impediments 
to growth, including those related to 
human resources. Let me give a few ex- 
amples. 

Problems in policy coherence are a 
common issue in transition countries, 
as in OECD Member Countries. In 
transition countries, OECD surveys 
have found particular problems in the 
linkages between unemployment bene- 
fits and the social assistance system, 
particularly concerning the long-term 
unemployed. As a consequence, in 
many countries a significant number of 
tlie long-term unemployed do not bene- 
fit from the placement and counseling 
services of the employment services. 
Many lose contact with the labor mar- 
ket. Other gaps in policy coherence can 
be found in the relationslup between 
education and labor market policy , with 
the result that graduates of educational 
programs risk having an education that 
fits poorly with the skills sought in the 
labor market. 

In terms of labor market policy, 
there is some evidence that many tran- 
sition countries could benefit from im- 
proved targeting of public programs. 
Given the limited amount of resources 
available for these programs, and the 
uneven distribution of unemployment, 
it is most appropriate to focus on the 
most vulnerable groups, such ^ the 
long-term imemployed. Targeting 
mi^t also take into account the geo- 
graphic distribution of labor market 
hardship. Also, evidence from the 
OECD’s review of the Czech labor 
market indicates that investing more re- 
sources in assisting the unemployed in 
their job searches, and in monitoring 
the job search efforts of the unem- 
ployed, leads to better results tlm oth- 
er methods in term of job placements. 

Many transition countries might 
benefit from the simplification of the 
unemployment benefits system. Often 
these systems involve complicated pro- 
cedures and calculations that strain the 
administration, while at the same time 
delivering insufficient benefits* One 
option for simplification might be to 



introduce flat rate systems on a tempo- 
rary basis, as in Poland. Another option 
for improving the effectiveness of un- 
employment benefit systems might be 
to improve the targeting of support 
measures by reducing benefits for those 
who voluntarily quit their jobs, and for 
new entrants to the job market. 

Improved systems to monitor per- 
formance, and provide feedback \o em- 
ployment service offices, may also aid 
in raising the efficiency and effective- 
ness of labor market programs. Anec- 
dotal evidence from some transition 
countries suggests that well-designed 
management information systems can 
contribute toward needed performance 
enhancements. 

As regards social policy, pensions 
are of the greatest pressing financial 
concern. As mentioned earlier, the 
long-term viability and effectiveness of 
pension systems in most transition 
countries will require a tightening of el- 
igibility criteria. 

In the area of education, the effec- 
tiveness of the system should be en- 
hanced by stressing the linkages with 
the labor market. One means for 
achieving this is to increase the in- 
volvement of the various stakeholders 
in the design and implementation of ed- 
ucational programs — that is, govern- 
ment representatives from non-educa- 
tion agencies, business representatives, 
and parents. More generally, education 
would benefit from improvements in 
national standards. 

These examples do not constitute a 
comprehensive j^licy framework. 
However, they signal some of the poli- 
cy components that most transition 
countries need lo consider within the 
ongoing transition process. 



m 



The interview with Mr. Zecchinl was 
completed In February, 1995. The fol- 
lowing OECD publications may be of In- 
terest to readers wishing lo pursue fur- 
ther the issues covered In the interview. 
Again, CCET stands for the Centre for 
Go-operation with Economies in Transi- 
tion. 
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Labor Market and Social 

Policy Icsues: 

Employment and Unemployment in 
Economies In Transition: Conceptual 
and Measurement issues. Eurostat 
CCET. Paris, 1993. 

The Labour Market in Poland. CCET. 
Paris, 1S93. 

Structural Changes in Centra! and 
Eastern Europe: Labour Market and 
Social Policy ImpliGations. A joint 
publication of the OECD and tha 
ILO. Paris, 1S93. 

Current Labour Market Problems in 
Russia. Qsnera! Distribution Docu- 
ment. CCET, 1939. 

Review of the Labour Market in the 
Czech Republic. Paper presented at 
the ELSA Committee Meeting in 
Prague, December 1994. 



Review of Labour Market and Social 
Policies of Hungary. Paper present- 
ed at the ELSA Committee Mesttfig 
in Budapest, October 1994, 

Short-Term Economic Indicators — 
Transition EGoriomies, Labour Mar- 
ket indicators Annex, No. 4, 1994. 

Unemployment in Transition Countries: 
Transient or Persistent CCET, 

1994. 

The Regional Dimension of Unemploy- 
ment in TrsnsHion Countries: A 
Chaiienge for Labour Market and 
Social Policies. Proceedings of the 
Technical Workshop on “Regional 
Unemployment in Centra! and East- 
ern Europe" jointly sponsored by the 
OECD's CCET in Paris and the "insti- 
tute for Advanced Studies in Vienna, 
November 1 994. 



Education 

Review of Higher Education in the 
Czech and Slovak Federal Repub- 
lics: Examiners' Report and Ques- 
tions, 1992. 

Review of Education Policy in Hungary: 
Examiners' Report and Questions, 

1993. 

Follow-Up Review of Higher Education 
in the Czech and Slovak Republics. 
Report to OECD’s Education Com- 
mitlse, 19S4. 

Seminar i: Quality Assurance and Ac- 
creditation in Higher Education. 
Genera! Distribution Document. 
CCET, 1994. 
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An in terview with Gary K. Jackson and John E. Drver 



On April 17, 1995, the United States 
Secfeta ,7 of Labor, Robert Reich, came 
to Washington State to meet with tha 
co-directors of the lAM/Boeing Quality 
Through Training Progr-am which Sec- 
retary Reich called a model of labor- 
management cooperation. “We are be- 
ginning to use this model around the 
country, and it’s v/oiking," Secretary 
Reich said. “Labor and Management 
can work together, even when the news 
lor workers is bad.' The Secretaiy also 
brought a check for $4.5 million in sup- 
port of the Boeing Reemployment Pro- 
gram. 

Leading the Quality Through Train- 
ing Program. John Dryer. Boeing Co- 
Director, and Gary Jackson, lAM Co-Di- 
reclor. work together with the support of 
a team of Administrators from both the 
company and the union tc develop 
training opportunities that assist IaM- 
represented Boeing employees Impact- 
ed by technology change, job ccmbina- 
tions, and worklorce reduction. The 
program is also proaclive in developing 
programs for the career and personal 



'VV* would like to convoy our special 
thanks to Hllon I tswiti, a staff person In 
OTTP. who ccnlributed substftnil(i.lly to this 
inireduotion, 



a©v6ioprn8nt of lAM hourty ompIcydQs 
at Soaing through a number of unictuo 
services. 

The Quality Through Training Pro- 
gram (QTTP) iiss piayed an integral 
role in planning and obtaining the fund- 
ing for the Boeing Reemployment pro- 
pam, which has two service centers of- 
fering a "one-stop sltopping" apjt.'oach 
to retraining and job placement servic- 
es for displaced Boeing workers. The 
Boeing Reem-ployment Program is ao- 
ministered by the State Employment 
Security Department (ESD). and brirtgs 
together The Boeing Company, the 
company’s two major unions — the In- 
ternational Association of Machinists 
and Aerospace Workers (lAM & AW) 
and Saattie Professional Engineering 
Fmployeos Association (SPEEA), local 
Privatis lndu.siry Councils (PiCs). a con- 
sortium o! seventeen Community and 
Technical Colleges, and the QTTP in a 
broad-based drive to help dislocatad 
workers and miiigate ihe affects of job 
lo-ss. 

The aerospace industry by its vary 
nature experiences po»ks arid valleys 
of employment. Because of Uie com- 



petitive market in which aerospace 
companies operate, and the volatility of 
orders under government contracts. 
The Boeing Company has always ex- 
perienced changes in the volume and 
characteristics of its workforce over 
time. This has been related to the gen- 
eral health of the economy, to trade re- 
lations, and to the state of technology 
However, by die iate 1980s Boeing was 
facing a new competitive environment 
that y/as cot?siderably iMemationaiized. 
The company was competing with sub- 
sidized aerospace designers and man- 
ufacture.'s !n other countries. There 
were recessions In the industrialized 
nations. And defense contractors, in- 
cluding Boeing, were coping with the 
f’iilitary downsizing that accompanied 
the end of tha Cold War. 

Tha specter of business losses that 
couid result from the reduced numbers 
of orders and the canceilation or post- 
ponemonl cf proviously-committeii or- 
ders from airlines, who were them- 
selves experiencing a business 
downturn, brought about the need to 
reassign, relocate, or lay off unpreco- 
donted numbers of employees, In addi- 
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tion, because of the intensifying Inter- 
national competition from state-subsi- 
dized aerospace companies, Boeing 
has had to drastically, pare production 
costs, exacerbating problems for work- 
ers. 

Although employment at the compa- 
ny was at its peak in 1 989, the lAM and 
the company were well aware of the 
forces that could affect employment 
conditions, if not the exact events that 
were to follow. Consequently, negotiat- 
ed into the collective bargaining agree- 
ment that year was the new jointly-run 
Quality Through Training Program, es- 
tablished to develop training programs 
for lAM-represented employees impact- 
ed by the above-mentioned conditions 
in the workplace. 

There were almost no layoffs during 
the period between 1983 and 1990 — a 
period of expanding business and high 
production for The Boeing Company. 
The problem then was building an ade- 
quate workforce to produce the compa- 
ny’s airplanes. 

Reductions in defense-contract work 
brought the first cloud on the horizon, 
resulting from the easing of the Cold 
War and the federal government’s 
downsizing of military programs. This 
affected the Boeing Defense & Space 
Group. Then came substantial aircraft 
production cutbacks directly related to 
the decline in the commercial aircraft 
market worldwide. Boeing Commercial 
Aircraft Group had to resize as produc- 
tion schedules shrank. Since Washing- 
ton State’s economy was to a signifi- 
cant extent dependent on Boeing, the 
downslzir^g made necessary by these 
cutbacks also had important ripple ef- 
fects on the hundreds of firms In the re- 
gion that constituted Boeing's extensive 
supply and service chain. 

By the end of 1 994, Boeing employ- 
ment had dropped 20,000 from the 
1989 peak of 107,000 employees, as 
reported by Secretary Reich during his 
visit here. This included attrition due to 
resignations and retirements, as well as 
layoffs. According to Washington Em- 
ployment Security Department figures, 
8,000 employees were laid off during 
1993 — the largest during any one year 
In the early 1990s. 

The Quality Through Training Pro- 
gram built up its Career and Personal 
Development Services for both active 
and laid-off lAM-represented employ- 



ees, to assist them in preparing for new 
career options. Funded under the 1989 
and 1992 collective bargaining agree- 
ments by an amount equivalent to 10 
cents per hour for ead^ lAW-represent- 
ed worker employed, with a guaranteed 
$10 million base, the Quality Through 
Training Program did much to help 
lAM-represented employees become 
ream ployed by offering an education 
assistance program and opening “Hori- 
zons” learning centers offering advis- 
ing, counseling, career exploration, and 
skills training. QTTP also saw the need 
to provide a placement function for em- 
ployees. 

In 1993, QTTP contracted with Main- 
stream Access and worked with Boeing 
Outplacement and the Washington 
State Employment Security Department 
(ESD) in a Job Opportunities Program 
to deliver services to lAM workers. The 
focus of the Job Opportunities Program 
was to provide the supportive environ- 
ment and services needed to help lAM 
employees become reemployed as 
quickly as possible. Job clubs were 
formed, where employees with similar 
interests and goals met together with a 
job counselor on a regular basis. The 
job dubs also afforded the opportunity 
to learn interviewing and resume writing 
skills. Job fairs, job and skill matching, 
and job placement services were in- 
cluded in the mix. 

Services provided by ESD's local 
centers ware als^ included, such as as- 
sistance with the Unemployment insur- 
ance Claim process, and job search 
and job placement on-iine through the 
Employment Service. ESD representa- 
tives were locate on-site at the QTTP 
offices. Since QTTTP was certified by 
the ESD to grant Commissioner-Ap- 
proved Training \ inder Title III of the 
Job Training Partnership Act — in fact it 
is the only private organization to enjoy 
that status — this program also provid- 
ed the benefit of being able to draw un- 
employment insurance white going to 
school through QTTP. 

The Job Opportunity Program gave 
rise to a new, expanded concept — one 
which brought wider participation from 
the community and provided a full 
range of benefits to all dislocated em- 
ployees of The Boeing Company. lAM- 
represented employees still took the 
major “hit" from downsizing the work- 
force, but other areas of the workforce 
were also being affected. The "one stop 



center” concept was included in an ap- 
plication for federal funding of two ma- 
jor Boeing Reemployment Centers In 
the Puget Sound area. 

John Dryer, Gary Jackson, and 
members of the Quality Through Train- 
ing Program staff, along with represen- 
tatives of the company, the 1AM and 
SPEEA unions, the Employment Secu- 
rity Department, Private Industry Coun- 
cils, and the State Board of Community 
and Technical Colleges formed a Labor 
Management Committee and started an 
Intensive effort to apply for funding un- 
der the Job Training; Partnership Act. 
Charles Wetmore and Delia Curry of 
the QTTP staff led the team that put to- 
gether the funding package. The appli- 
cation for funding featured the ESD as 
administrator for the program. This ap- 
plication was granted and an unprece- 
dented $5 million was awarded to the 
project — the highest up to that date for 
any Washington State program. 

The Boeing Reemployment Pro- 
gram, a comprehensive program deliv- 
ering a full range of reemployment ser- 
vices at two ono-stop, multi-service 
centers — a remarkable private/publlc 
partnership between The Boeing Com- 
pany, its unions, and government agen- 
cies and institutions — was born. 



The interviewer had the opportunity 
to talk with the two QTTP co-directors 
in March 1995. The following interview 
is the result of this meeting. The inter- 
viewees are John Dryer and Gary Jack- 
son. 

Gary Jackson is Co-Director of the 
lAM/Boeing Quality Through Training 
Program, which is jointly sponsored by 
the International Association of Machin- 
ists and Aerospace Workers and The 
Boeing Company to address the train- 
ing and employment needs of active 
and laid-off Boeing workers who have 
been affected by Ganges In the aero- 
space industry. 

Mr. Jackson, an experimental elec- 
tronics technician while at Boeing, held 
numerous Union positions as a Local 
Lodge officer prior to becoming a full- 
time staff person with District 751 of the 
International Association of Machinists 
and Aerospace Workers. He has 
served in the Union’s Health and Bene- 
fits and Wage Determination offices, as 
well as Contract Negotiations. He has 
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been involved with the Quality Through 
Training Program since its inception in 
1989. first as a Joint Policy Board 
member and now as Co-Director. 

John Dryer is the Chairman of the 
Labor-Management Committee In- 
volved with the Boeing Reemployment 
Program, and Co-Director of the lAM/ 
Boeing Quality Through Training Pro- 
gram. A design engineer, Mr. Dryer was 
Director of Labor Relations at Boeing In 
Kansas prior to coming to the QTTR 
He has served as a consultant on ne- 
gotiation strategies for contract negotia- 
tions In both the public and private sec- 
tor. and has lectured on laboi 'delations 
at the University of Puget Sound. 

Mr. Dryer has been Intensely in- 
volved in the evolution of the Quality 
Through Training Program, providing ' 
guidance to the program In addressing 
the personal, training and career needs 
of workers. His emphasis on Joint 
union/management sponsorship has re- 
sulted in a high level of acceptance of 
these programs by both Boeing and 
union management. 



Question; As the initial effort to as- 
sist the major segment of the Boeing 
workforce, both those needing to be as- 
signed to new jobs within the company 
and those ultimately dislocated — is 
the model established by the Quality 
Through Training Program the core of 
the Boeing Reemployment Program? 
And what are the main elements of 
QTTP*s program design? 

Gaiy Jackson; The Quality Through 
Training Program came into being to 
provide lAM-represented employees of 
The Boeing Company with learning op- 
portunities that can lead to career 
growth, provide job security, and re- 
train employees impacted by changes 
in the workplace due to technology 
change or job combinations. This con- 
cept of cooperation between company 
and union in order to provide important 
career and education opportunities is at 
the heart of all QTTP activities. Bring- 
ing the company, unions, educational 
institutions, Private Industry Councils, 
the Employment Security Department, 
and other federal and state agencies to- 
gether in a cooperative effort to benefit 
employees is a natural outgrowth of 



this philosophy. In addition, the “one 
stop center*' concept is a key feature of 
previous QTTP job placement activi- 
ties, and provided the organizational 
framework for the Reemployment Pro- 
gram. 

Our major issue at this time is the 
impact of company downsizing on our 
employees. QTTP offers Career and 
Personal Development programs for 
both active and laid-off lAM-represent- 
ed employees of The Boeing Company. 
QTTP’s support and leadership in re- 
gard to the Labor Management Com- 
mittee and the Boeing Reemployment 
Centers has helped a great many laid- 
off employees “land on their feet*’ and, 
as Secretary Reich put it, “prove that 
there can be new work and new life af- 
ter the pink slip.” 

Career and Personal Development 
programs include four full-scale advis- 
ing and learning centers at this time; 
the Advising and Learning Center at 
our main offices in Tukwila, Washing- 
ton; the North Site Advising and Learn-- 
ing Center in Everett, Washington; the 
Wichita, Kanse^St Advising and Learn- 
ing Center; and a new QTTP/Boeing 
Advising and Learning Center in Port- 
land, Oregon, A fifth is due to open 
soon. Two of these locations also ad- 
minister the QTTP Education Assis- 
tance program — which offers an an- 
nual benefit to active or laid-off 
lAM-represented employees of the 
company. Active lAM employees can 
receive up to $2,000 per calendar year 
for education and training at state-rec- 
ognized institutions, and laid-off em- 
ployees whose training needs do not fit 
the Boeing Reemployment Program 
guidelines for retraining can receive up 
to $2,500 per year for three years after 
layoff, beginning on the date of their 
layoff from the Company. These bene- 
fits are available to all lAM-represent- 
ed hourly employees, regardless of 
their location. 

QTTP*s Career and Personal Devel- 
opment initiatives include a broad spec- 
trum of career development and skills 
enhancement programs for employees. 
Through this program employees can 
meet with professional advisors to de- 



velop their own individualized career 
education plan, utilize career assess- 
ment tools, participate in on-site com- 
puter-based training, or be referred to 
other training/educationai opportunities 
which match their skills and pace of 
learning. In addition, the program of- 
fers on-site courses in math, reading, 
writing, creative thinking, problem 
solving, presentation skills, and study 
skills. Tutors are available on-site. 
Community and technical colleges pro- 
vide tlie professional advisors and adult 
basic educational instructors. English 
as a Second Language (ESL), and a re- 
cent addition, American Sign Language 
classes are available for lAM employ- 
ees. ESL classes, offered in partnership 
with organizations throughout the com- 
pany, are set up for both active and 
laid-off employees in several locations 
convenient to either their workplace or 
home. 

QTTP’s other two initiatives — pro- 
viding assistance to lAM employees 
impacted by technology change and job 
combinations — address the training 
needs brought on by change in the 
workplace. This includes lAM-repre- 
sented employees whose jobs are af- 
fected by technology change (defined 
in the collective bargaining agreement 
as technological improvement in 
“tools, methods, processes, equipment 
or materials”) such as employees at the 
new Chemical Pro cess Line and the 
Calibration Lab. For the new Chemical 
Process Line, self-paced video and 
computer instruction developed by 
QTTP in cooperation with Boeing 
Training Organization is located right 
at the workplace and a peer mentor 
training syrtem is in place. Calibration 
Laboratory employees can access a so- 
phisticated interactive electronics 
course cooperatively developed by 
QTTP and Boeing Training that incor- 
porates the elements of an AA degree 
in electronics. Technology change re- 
training has been developed and deliv- 
ered in a number of other locations in 
Washington, in Portland, Oregon, and 
in Wichita, Kansas. 

Job combinations occur when the 
Corporate Jobs Committee agrees to 
combine two or more bargaining unit 
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jobs. QTTP has a responsibility to iden- 
tify what additional training needs may 
be required for the affected employees 
to do the new combined job. QTTP in- 
vites employees as subject matter ex- 
perts and line managers in the areas 
where jobs were combined to partici- 
pate in a training needs analysis. The 
requirements of the new job are scoped 
out through brainstorming techniques, 
then validated and verified by addition- 
al groups of subject matter experts. 
Finally, the skills list is given to Boeing 
Training for identification of the train- 
ing courses required for each job level. 
The purpose of using this job task anal- 
ysis is to gather data from the employ- 
ees who actually do the work. 

The Quality Through Training Pro- 
gram has shown that the union and the 
company, working together, can help to 
increase opportunities for Boeing 
workers and provide Boeing with a 
highly skilled workforce for a changing 
work environment. 

Question: How was the Boeing Re- 
employment Program established and 
organized and how is it being funded? 

John Dryer: The new Labor-Manage- 
ment Committee brought together rep- 
resentatives of a wider array of constit- 
uencies, and charged them with 
responsibility for a new program spe- 
cifically targeted to dislocated Boeing 
workers across all divisions of the com- 
pany. These representatives were to 
speak for an impressive group of stake- 
holders: 

■ The Boeing Company. 

■ The International Association of 
Machinists and Aerospace Workers. 

M The l AM/Boeing Quality Through 
Training Program. 

■ The Seattle Professional Engineer- 
ing Employees Association. 

B The Washington State Employment 
Security Department. 

ai The State Board for Community and 
Technical Colleges. 

■ Several Private Industry Councils: 
Seattle/King County, Pierce County, 
and Snohomish County. 



O 




m The Region X office of the U.S. De- 
partment of Labor. 

In early 1993, QTTP, leading the ef- 
fort to obtain federal funding, contract- 
ed with the Human Resources Develop- 
ment Institute (HRDI) in Washington, 
D.C., an arm of the AFL-CIO, to ^sist 
with the program design and applica- 
tion. HRDI worked with the Labor- 
Management Committee as a facilitator 
to develop and submit a grant proposal 
to the U.S, Department of Labor for a 
National Reserve Grant under Job 
Training Partnership Act (JTPA) Title 
III, for services to Boeing workers 
meeting the eligibility criteria under the 
Economic Dislocation and Worker Ad- 
justment Assistance Act. 

The initial request wa for $10.2 
million for a new Boeing Reemploy- 
ment Program for approximately 3,800 
dislocated Boeing workers. The request 
was urgent, as existing budgets ac- 
quired through unprecedented leverag- 
ing of funds and in-kind contributions 
across a number of private and public 
sources were insufficient to meet the 
needs of the large numbers of workers 
dislocated in the 1990s. The new pro- 
gram redefined the unemployment sys- 
tem to a reemployment system and in- 
troduced a number of new concepts 
that met the current thinking of the De- 
partment of Labor: a public/private 
partnership; one-stop shopping for ser- 
vices; a consolidation of customer-fo- 
cused services; market-driven training, 
and worker empowerment and account- 
ability. 

In reviewing the request, the U.S. 
Department of Labor awarded an im- 
mediate grant of $5 million and an op- 
tion for requesting additional funding 
should the award prove inadequate to 
the need. Experienced in operating 
JTPA Title III and other employment 
and training programs, the Washington 
State Employment Security Department 
was to receive the National Reserve 
Grant on behalf of the Labor-Manage- 
ment Committee, and was assigned the 
role of administrator and operator of 
the program. 

With the federal grant in hand, the 
Labor-Management Committee imme- 




diately set to work on opening two one- 
stop, multi-service Boeing Reemploy- 
ment Centers, one in each of the major 
counties v/here Boeing dislocated 
workers live and work, and a satellite 
center in a third county. These centers 
involve the out-stationing of staff from 
Boeing Outplacement, both unions, the 
Washington Employment Security De- 
partment, Private Industry Councils, 
and the State Board for Community 
and Teclinical Colleges. 
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Secretary of Labor Reich pro- M 

nounced the Boeing Reemployment ^ 

Program a model program that he 
wanted to replicate elsewhere through- 
out the United States. On June 20, 

1994, Vice President Al Gore and Sec- , 

retary Reich presented the "Hammer ^ 

Award” to the Boeing Re-employment 
Centers for "Putting Customers First.” | 

The success of the Boeing Reem- 
ployment project was acknowledged in 
September 1994 when the U.S. Depart- 
ment of Labor awarded an additional 
$5.2 million to assist laid-off Boeing 
workers in Washington State. This en- 
sured that the centers could continue to 
provide dislocated worker services to ^ 

all laid-off Boeing workers, including 
an additional 1,000 employees. Of this 
requested amount, the largest propor- 
tion was for longer-term retraining, ^ 

along with money earmarked for sup- 
portive services such as child care and 
transportation, additional case man- 
agement for work-based learning and 
job development staff, and a full-time j 

project director for the program. J 

The additional funding received on 
April 17, 1995, adds another $4.45 mil- 
lion — just in time to meet the needs of 
employees who will be impacted by ap- 
proximately 6,000 more layoffs an- 
nounced by Boeing for 1995, and 
bringing the total grant to $14.65 mil- 
lion. m 

Looking at all the resources support- 
ing the Boeing Reemployment Pro- 
gram, we see an inventive combination 
of public/private funds and progran^s to 
service dislocated workers. In terms of 
funding, the program is utilizing spe- 
cial federal funds, regular federal pro- 
gram dollars, and funds associated with 
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a new state legislative initiative that has 
expanded training slots in the state’s 
community and technical college sys- 
tem. Regarding programs and related 
support, the Program is bringing to- 
gether federal, state, and sub-state pro- 
grams; personnel in community and 
technic^ colleges; facilities, equipment 
and staff contributed by The Boeing 
Company; the lAM/Boeing Quality 
Through Training Program, lAM and 
SPEEA volunteer representatives, and 
other Boeing programs. 

To date, over 12,000 employees 
have utilized Reemployment Center 
outplacement services. Approximately 
5,580 Boeing employees have obtained 
employment, and 3,365 employees are 
enrolled in JTPA retraining programs. 

Question: We have been hearing a 
great deal about European models of 
collaboration between government, 
business, and labor, related to the cur- 
rent U.S. efforts to increase cooperation 
among these different constituencies. 
While this kind of partnership has been 
more traditional in Western Europe, 
these three groups have often behaved 
in an adversarial manner in the United 
States. How difficult has it been to de- 
velop this kind of partnership for Boe- 
ing workers? 

Gary Jackson: Clearly it has been a 
greater challenge to develop a govem- 
ment/business/labor partnership in the 
Reemployment Program than it was to 
coordinate resources in the lAM/Boe- 
ing Quality Through Training Program. 
The Reemployment Program brings to- 
gether many more diverse, but well-es- 
tablished organizational entities. Asso- 
ciated clusters of stakeholders had to be 
brought together around reasonably 
common purposes and goals for our 



workers. Accommodating the various 
cultures, policies, and practices of these 
groups has required a great deal of 
trust, commitment, communication, 
and sometimes negotiation. 

The partnership involved accommo- 
dation and a willingness to cooperate in 
areas where organizations might be ac- 
customed to having full discretion and 
authority. Many strong organizations 
have been involved. In my opinion, the 
partnership has been an outstanding 
success. 

The Boeing Reemployment Program 
represents a significant human resource 
and reemployment effort involving a 
large multinational corporation — and 
key labor unions — and three levels 
of government. The program is also 
unusual in its commitment to keep 
communication open with employees, 
elected officials, business and labor 
conununities, and others invested in the 
program, concerning the program’s 
progress. 

Question: Who has oversight respon- 
sibilities regarding the Boeing Reem- 
ployment Program, and how are its re- 
sults to be judged? 

John Dryer: Because of the multiple 
funding streams and programs for this 
new effort — and the fact that differ- 
ing expectations and formal regulations 
exist among them regarding the evalua- 
tion of performance — there is no one 
source or method of assessment for the 
entire prog^. Nevertheless, oversight 
responsibilities are given strong atten- 
tion by the Labor-Management Com- 
mittee and the program’s administrator. 

The use of Title 111 funds and a Na- 
tional Reserve Grant require compli- 
ance with federally-mandated monitor- 



ing and evaluation requirements. Al- 
though no net impact study of EDWAA 
has been conducted at the national lev- 
el, the Department of Labor did con- 
tract with a competent research firm to 
study EDWAA implementetion. The 
latter may serve as a useful model for 
studying coordination and service de- 
livery in the Boeing program 

The use of state funds for increased 
community and technical college op- 
portunities for dislocated workers, 
which involves a set-aside for Boeing 
workers, will require evaluation activi- 
ties consistent with the evaluation plan 
developed by the State’s Worfforce Ed- 
ucation and Training Coordinating 
Board, which calls for a study of both 
the implementation and the legislative 
intent behind this funding, and a study 
of outcomes for participants, employers 
and the conununity college system. 

The Labor-Management Committee 
has selected a set of outcome measures 
and has established quantitative goals 
for monitoring the Reemployment Pro- 
gram, such as “entered employment 
rate,” average wage at entered employ- 
ment,” “cost per participant,” and “cost . 
per entered employment.” In addition 
the Committee is interested in request- 
ing private/public %nds to conduct a 
study of the program’s overall efficien- 
cy and effectiveness. 

On a human level, the fact that so 
many former Boeing employees are re- 
ceiving retraining and have found em- 
ployment through the program, at a rate 
of pay equivalent to what they earned 
at Boeing, constitutes the highest mea- 
sure of success. This program has dem- 
onstrated that a cooperative partnership 
approach to dealing with dislocated 
workers can and does work. 
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At the International Level 



Editoriat Intrqductibn 



This portion of Issue #11 emphasizes 
economic reform and restructuring Is- 



sues In the European Union and the 
former Soviet Union. These are issues 
facing all industrialized nations, even 
though to varying extent, In the new in- 



ternational economy. They are issues 
about which American employment and 
training professionals need to remain 
informed. 



Economic Reform in the European Union 



Editorial Introductiori 



In the midst of negotiations to form a 
12-member European Union (EU), the 
definition of “Europe" has grown in- 
creasingly elusive. The eligibility re- 
quirements for membership in the Euro- 
pean Community (EC) have reflected 
that confusion. The Maastricht Treaty of 
1991 proposed that “any European 
State whose systems of Governance 
are founded on the principle of democ- 
racy may apply to become members of 
the Union." But the concept democracy 
was not spelled out precisely. The or- 
ganization of free elections, the prac- 
tice of the rule of law, and respect for 
civil and human rights were assumed to 
underiy this concept. But member 
countries were also expected to devel- 
op stable market economies based on 
private entrepreneurship. These twin in- 
tentions complicated the Issue of eligi- 
bility since countries varied consider- 
ably in the extent to which they had 
applied these abstract concepts. 

Beyond that, the gradual enlarge- 
ment of the EU, however Inevitable, 
has remained controversial politically 
and economically. A significant memo- 
randum submitted to the European 
Council in the early 1990s by the three 
Benelux countries stressed that mem- 
bership for the smaller countries could 
change the nature and form of the Eu- 
ropean Community, might distort the 
basic oblectlves of the founder nations, 
and would likely erode the position and 
role of the smaller members. France 
has taken the position, for example. 



that the EU must first consolidate its 
own internal development so that en- 
largement does not have a destabiliz- 
ing effect on European unity. 

The issue of EU enlargement is only 
one of many difficult issues faced by 
the leaders of this Important experiment 
in transnational integration. However, 
the increased consolidation of Europe 
has substantial economic Implications 
for the rest of the world, since it will 
vastly expand intra-European trade and 
expand the EU’s access to global mar- 
kets. And the EU’s growing regional co- 
operation agreements with surrounding 
non-EU nations will play a significant 
role in creating a larger European eco- 
nomic structure. Already European vot- 
ers participate in the election of the Eu- 
ropean Parliament. There is already a 
European Council of Ministers, a Euro- 
pean Council, a European Commission, 
and a European Court of Justice. The 
Single European Act of 1 986 supported 
the development of a common market 
for goods, labor, capital and services. 
The Treaty on European Union in 1991 
strengthened political and monetary 
ties. 

Within this larger framework, the Or- 
ganization (or Economic Cooperation 
and Development (OECD) has played a 
critical advisory role In providing cross- 
national data and policy analyses on a 
range of Issues confronted by the most 
advanced Industrial nations. Including 
the EU. The OECD was established In 
Paris in 1901 tc promote the following 
Impressive goals: 



■ To achieve the highest sustainable 
economic growth and employrnent, 
and a rising standard of living in 
member countries, while maintaining 
financial stability, and thus to con- 
tribute to the development of the 
world economy. 

■ To contribute to sound economic ex- 
pansion in member as well as non- 
member countries in the process of 
economic development. 

■ To contribute to the expansion of 
world trade on a multilateral, non- 
discrimlnatory basis in accordance 
with International obligations. 

The original member countries of the 
OECD were the world’s major industri- 
alized nations — eighteen nations in 
Western Europe, and the U.S.and Can- 
ada. Although less industrialized, Tur- 
key was also a member. Later Japan, 
Finland, Australia, New Zealand and 
Mexico were added. The Commission 
of the European Communities now par- 
ticipates in the OECD’s studies and 
other projects, and OECD has extend- 
ed Its work to encompass economic is- 
sues in Central and Eastern Europe, 
and the republics of the former Soviet 
Union. 

In this series of articles we look at 
labor market issues in the European 
Union, and agein focus the microscope 
on the new employment and training 
Inlliative in Great Britain. In the pro- 
cess, wp rely on a number of analyses 
such an those carried out by the OECD. 
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The OECD’s 
Employment Study 

In 1992 the ministers of the coun- 
tries with membership in the Organiza- 
tion for Economic Cooperation and De- 
velopment requested a literature search 
and major study addressing key issues 
in several broad areas; macroeconomic 
I^licy, trade, technology, wage forma- 
tion, labor adjustment, education and 
training, and benefit systems and taxa- 
tion. OECD’s response to this mandate 
is reported in two volumes: 1) The 
OECD Jobs Study: Facts, Analysis, 
and Strategies, and a background vol- 
ume 2) The OECD Jobs Study: Evi- 
dence and Explanations. In this artii.!“ 
we review the first of these companion 
reports. 

The emphasis in this international 
study is on unemployment, the most 
troublesome aspect of capitalist econo- 
mies. This focus is consistent with the 
OECD’s mission to contribute expert 
opinion and the results of research to 
the efforts of industrialized nations to 
1) achieve prosperitj' and 2) maintain 
their ability to be innovative in coping 
with an increasingly integrated and 
Competitive global economy. 

The major recommendation in the 
OECD report is that nations must em- 
brace change, rather than slow its mo- 
mentum or offer too much protection to 
activities that have not adapted success- 
fully to the significant changes occur- 
ring in the world. Strategies that pro- 
mote adjustments to change and 
enhance social cohesion while such ad- 
justments are being made, are viewed 
as the route postindustrial societies 
must take if they are to provide the lev- 
el of life quality they have traditionally 
valued for their citizens. 

Facts and Assumptions 

According to the report, 35 million 
people were unemployed in OECD 
countries in 1994 — 8,5% of the OECD 
labor force. Another 1 5 million were 
thought to have given up looking for 
work, or had needed to accept a part- 
time job. A third of young workers in 
some of these countries had no job. 



Only a portion of this unemployment 
was cyclical. Much of it was attrributed 
to structural factors. Most of this struc- 
tiual unemployment was considered by 
the OECD analysts to be the result of 
dissonance between pressures on eco- 
nomic systems to adapt to global eco- 
nomic change, and their willingness 
and ability to do so. 

These analysts made the assumption 
that the OECD economies were not 
flexible enough in coping with nev/ 
technologies and trade challenges, and 
therefore were relying too heavily on 
methods that were protectionist, that 
sought to restrict competition. And they 
believed that these nations had placed 
too little emphasis on developing new 
products and new processes, new kinds 
of workforces and workplaces, and new 
wc^s of creatingjobs. 

The Nature of Unemployment 

The number of unemployed in 
OECD countries tripled within a single 
decade, between 1972 and 1982. An 
easiiig of the prolonged period of eco- 
nomic decline of the late ’70s and early 
’80s was reduced only slightly by sub- 
sequent economic progress, and then 
rose sharply again after 1990, accord- 
ing to the report. However, the upward 
trend in unemployment was more se- 
vere in the European Community (EC) 
and in Oceania (Australia and New 
Zealand) — 10-1 1% in 1994, as com- 
pared with approximately 7% in the 
U.S. at that time. Unemployment stabi- 
lized at 2-4% in the European Free 
Trade Association (EFTA) countries — 
Austria, Finland, Iceland, Norway, 
Sweden, Switzerland and Leichtenstein 
— until 1990 when it rose rapidly to al- 
most 8% in 1994. Japan’s 1994 rate 
was 3%, in the context of 1-3% 
throughout the post WWII period. 

The report indicates thsXyoung peo- 
ple and women were most affected by 
unemployment. Austria and Germany, 
with strong apprenticeship systems, 
were exceptions to the high youth un- 
employment rates elsewhere. In Italy, 
Spain and Finland more than 30% of 
young people were unemployed. Wom- 
en had higher unemployment rates than 
men in the EC, except for the United 



Kingdom. In most other OECD nations, 
unemployment rates were higher for 
men. Regional differences occurred 
more in Europe than in the U.S. Age 
was another factor. 

There was a striking difference in 
long-term unemployment rates. In the 
European Community, 40% of the un- 
employed were unemployed long-term 
compared with 15% in EFTA and 1 1% 
in North America (U.S. and Canada). 

In several EC countries more than two 
out of every three unemployed older 
workers were unemployed long-term. 

In general, the OECD statistics suggest 
Aat EC countries have a greater rehir- 
ing/reemployment problem than other 
member nations, given the correlation 
between the low rates of flow back into 
the labor force and the high incidence 
of long-term unemployment. In the 
U.S. and Canada, workers have a great- 
er risk of becoming unemployed but a 
better chance of reemployment. 

Changes in the Size and 
Composition of the Labor Force 

The working-age population in all 
OECD countries is growing more slow- 
ly than previously, the report points 
out. North America and Oceania have 
experienced a fairly rapid decline, but 
the EC, EFTA and Japan have experi- 
enced a greater decline overall. Howev- 
er, the size of the working-age popula- 
tion participating in the workforce 
grew significantly to 75% in North 
America, Oceama and EFTA, remain- 
ing largely unchanged over the past 
thirty years in the EC countries (67%). 

Higher enrollments and retention 
rates in education spelled a decline in 
the labor participation of young people, 
while early-retirement plans and dis- 
ability pensions reduced the number of 
older workers. The report concludes 
that these developments had the effect 
of infusing some labor forces with 
more highly qualified labor market en- 
trants. 

Job Growth 

Growth in employment has been 
strongest in North America and Ocean- 
ia, the report says, and weakest in the 
EC and EFTA, with Japan in between. 
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The EC’s slow job growth rate is felt to 
be related to its slower population 
growth and the lack of increase in the 
proportion of its population in the 
workforce. Job growth has occurred 
predominantly in the service sector in 
all OECD countries. Agncultural em- 
ployment declined from 14% in 1970 
to 77% in 1994. Industrial employment 
decreased from 40% in 1970 to under 
30% in 1992. The share of OECD em- 
ployment in the service sector rose 
from less than 50% in 1970 to approxi- 
mately 65% in 1992. Most new jobs in 
the 1980s were in financial services, in- 
surance and business services, and 
community and personal services. 

The growth in international trade 
and technology are likely responsible, 
according to the report, trade having 
grown faster than the Gross National 
Product. Most member countries* trade 
has been with other OECD nations. 
Their exports to other countries have 
tended to have a relatively high skill 
content in contrast to their imports, 
which are most frequently labor-inten- 
sive raw material and manufacturing 
products. 

The largest OECD countries, witii 
large domestic markets, have spurred 
the greatest amount of high-technology 
manufacturing, but high-tech produc- 
tion has become a viable option for the 
smaller nations as well. For example, 
Ireland, Australia, Finland and Norway 
have been quite successful in the high- 
tech area, in addition to Japan. 

In thirteen OECD nations, non-farm 
self-employment has grown faster than 
overall job growth, particularly in the 
UK. Part-time employment has in- 
creased as a share of total employment 
in all OECD countries, with women ac- 
counting for most of the increase. Tem- 
porary employment has not appeared 
to increase except in France and Spain 
where there has been a deregulation of 
work contracts. Two-thirds of the job 
growth in the EC and EFTA since the 
1970s has taken place in the public sec- 
tor in contrast to the U.S. and Japan 
whose increase in jobs has occurred 
mainly in the private sector. However, 
public sector employment growth 
slowed in Europe in the 1980s, and the 



growth in private sector employment 
has increased. 

Wages in Employment 

The OECD report reminds us that 
“the process of wage determination is 
strongly influenced by labour market 
pressures, social perceptions, legisla- 
tion, and industrial relations systems, 
which all affect the evolution of real 
wages and wage differentials.*’ Wage 
shares in national income, the report 
says, decreased to below 1970 levels 
following the 1979 oil-price crisis. At 
the same time, wage differentials be- 
tween low V5. high-skilled workers wid- 
ened in the English-speaking countries, 
while EC differentials remained rela- 
tively unchanged. In fact, low pay was 
more prevalent in the U.S. than in other 
OECD countries. In the *90s one-fourth 
of all full-time workers in the U.S. 
earned less than two-thirds of median 
earnings, compared with one-tenth in 
Australia and one-fifth in the EC. In 
1990 almost one-fifth of all full-time 
U.S. workers had earnings at or below 
the official poverty level This is in the 
context of a general movement of job 
growth from unskilled to more highly 
skilled jobs. 

Implications for Employment 
Policy 

The analysts preparing the report 
on the Jobs Study view the unemploy- 
ment scenario with concern. Further- 
more they feel that the debate over its 
causes has been seriously flawed. A 
number of myths have been reinforced 
— such as that technology increases 
unemployment, that imports from low- 
wage countries depress wages and pro- 
duce unemployment, and that the inten- 
sity of global competition is to blame. 
The evidence developed over the past 
four decades would suggest, they say, 
that none of these factors is the primary 
cause of rising unemployment. The 
problem is that each causal theory 
leads to a different policy conclusion, 
whether the theory is warranted or not. 

Again, these analysts look for the 
main cause in the gap between the need 
for these countries to adjust to global 
changes affecting economic systems, 



and their capacity and willingness to 
adjust. This gap was created, they in- 
sist, by rigid even if well-meaning eco- 
nomic, labor market and social policies 
that had the unintended effect of de- 
creasing the ability of economies to 
adapt to change. 

They ask us to review history begin- 
ning in the mid-1960s. Essentially, ev- 
erything was coming up roses for all 
OECD countries in terms of stability, 
growth and trade. But by the middle of 
the 1960s economic performance had 
begun to decline and inflation to rise. 
This produced an uneasy economic en- 
vironment. Exchange rates became 
less predictable with the breakdown of 
the system of fixed rates. In the 1980s 
the deregulation movement regarding 
financial and product markets enhanced 
efficiency while accelerating change. 
These and related trends made it more 
difficult for economies to adapt. 

The challenge of adjustment was 
made stronger by continuing rapid 
technological change, particularly in 
information technology, and by ^e in- 
ternationalization of economic activity. 
Just at this juncture, when more flexi- 
ble economies were sorely needed, pro- 
tective social policies extending social 
benefits were introduced. The assump- 
tion is that these protective policies 
made these economies more rigid. 

Within this general history, the U.S. 
experience was somewhat novel. Pro- 
tective labor market and social policies 
were less extensive, labor markets more 
flexible, and job growth was occurring 
mainly in the private sector. Many 
jobs were high skill and high wage. 
Many were low skill and low pay. 
Workers without skills had no option 
but to accept the latter because of the 
low level of social support. On the oth- 
er hand, these workers might have been 
worse ofr*with a more rigid economy 
that pre .luded any job at all. 

Both the widespread unemployment 
in other OECD countries, and the di- 
chotomy in the kinds of jobs available 
in the U.S., were thought to stem from 
the failure to adapt to the trends emerg- 
ing over previous decades. Managerial 
skills, (he organization of workplaces, 
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general productivity and workforce 
preparation had not kept up with a 
more technologically advanced econo^ 
my. While a lack of adjustment meant 
more low paying jobs in the U.S., it 
meant greater imemployment in the EC. 
The development of a low-paying job 
sector in EC countries had been pre- 
vented by practices such as state-im- 
posed or union-negotiated wage/income 
floors and employment protections. 

Preserving Social Objectives 

Although the main policy message in 
the report is that the solution to high 
unemployment is the restoration of 
economies* and societies’ capacity to 
adapt to change, the report’s sub-theme 
is that this restoration must not come at 
the expense of an abandonment of so- 
cial goals. To satisfy such restoration 
while preserving protectionist values 
has been a formidable task. 

The analysts propose that the key is 
to reform social policies such that Ihey 
no longer have negative economic side- 
effects. They do not see such reform 
impossible to achieve, if policy experts 
will 1) study the spectrum of social pol- 
icies implemented over the past three 
decades, 2) assess to what extent they 
may have crippled economies’ adjust- 
ment capabilities, and 3) analyze what 
strategies may be feasible for removing 
such disincentives without dismantling 
desirable social protections. The re- 
search and analysis already completed 
should, they say, provide a useful 
framework for such reform. This frame- 
work is summarized in the second vol- 
ume of the Jobs Study. 

Some Conclusions 

The OECD report focuses on cycli- 
cal as well as structural unemployment 
in drawing conclusions about how 
member nations should approach their 
major task. Therefore their ultimate rec- 
ommendations involve the macroeco- 
nomic environment as well as job cre- 
ation and workforce preparation — that 
is, they consider that both macroeco- 
nomic and structural policies are need- 
ed. 



Macroeconomic Policies 

The report proposes that the macro- 
economic environment influences an 
economy’s ability to create viable jobs 
in response to change. Certain ingredi- 
ents should be part of macroeconomic 
policy, the analysts suggest, if that en- 
vironment is to have the right effect: 

B Sufficiently high levels of national 
saving and investment: Since the 
mid-1970s, national savings and in- 
vestment as a share of national in- 
come have declined significantly in 
OECD countries, particularly in Eu- 
rope. 

■ Price stability and low rates of in- 
flation: Employers need to receive 
"undistorted price signals from the 
markets” if there are to be effective 
structural adjustments. 

■ Budgetary efficiency and high-quali- 
ty public sector spending and taxa- 
tion: Boosting economic growth at 
the cost of higher inflation should be 
avoided, the analysts point out, since 
the subsequent need to tighten could 
result in lower average growth over 
a number of years. 

The report recommends an integra- 
tion oi structural and macroeconomic 
policies, since structural reforms, it 
states, will not work well in an unstable 
macroeconomic environment. On the 
other hand, macroeconomic policy is 
more likely to be effective if structural 
policies prevent inflexibility and allow 
resources to be used most profitably. 
Structural change in good economic 
times is less painful, but the need for 
such change is not as evident and is 
therefore more difficult to rationalize. 
But when economic demand is weak, 
structural reforms can involve worker 
dislocation with little job creation else- 
where to absorb those workers, and this 
effect can reduce political support for 
change. The report therefore recom- 
mends the simultaneous implementa- 
tion of structural and macroeconomic 
reforms. 




The proof of the effectiveness of 
these reforms for workers, the analysts 
say, is in the creation of more new jobs. 

Where Job Creation Is Most 
Likely to Occur 

The following predictions and rec- 
ommendations are made in the report: 

a New jobs must be generated by the 
private sector, given government 
budget deficits and resistance to tax 
increases in member nations. 

■ Many new jobs will have increasing- 
ly high knowledge requirements, 
particularly those involving tradable 
goods, related to the need to im- 
prove productivity in innovative 
businesses that have the ability to 
use technology effectively. 

H Many new jobs will likely be low- 
productivity, low-wage jobs, which 
may help absorb the significant 
numbers of low-skilled unemployed. 
The report cautions, however, that 
tax concessions and/or employment 
subsidies supporting the creation of 
low-wage jobs should be avoided, 
while policies that inhibit low-wage 
job creation should also be resisted 
due to the high unemployment rates. 

Clearly these predictions and sug- 
gestions involve a fine balancing act 
between two important concerns: 1) the 
general undesirability of deliberately 
creating low-wage jobs, and 2) the de- 
sirability of creating jobs for unem- 
ployed workers lacking the skills re- 
quired by high-productivity, high-wage 
firms. 

Technological Change 

The report claims that technology, 
historically, has generated more worker 
earnings than displaced workers. Ja- 
pan’s shift to high-tech industries, for 
example, led to a 4% increase in manu- 
facturing employment in the 1970s and 
1980s. The EC experienced a 20% de- 
crease in manufacturing employment, 



- ® 

ERIC 



70 



TS" 



EvUuatlon Forum » issuaH . Summon 995 






associated with an emphasis on lower- 
wage^ lower-technology industries. 

Critical to the positive relationship 
between technological change and job 
creation is effective absorption, appli- 
cation and diffusion of new technolo- 
gies, such as ctirrent strides in informa- 
tion technology. Government subsidies 
to firms tend to discourage this kind of 
innovation. Pooling resources to pro- 
mote basic research and the application 
of new technologies, particularly those 
with the higher risks, is recommended 
as an alternative strategy. 

Small Business 

Entrepreneurship 

The report encourages support for 
“dynamic entrepreneurship” in the 
form of removing regulatory barriers to 
new and expanding private sector busi- 
nesses. Currently government resourc- 
es, such as protective subsidies, are tar- 
geted to large firms. Small business 
development requires support for the 
following, according to the OECD ana- 
lysts: worlforce preparation; adequate 
physical infrastructure; modern tele- 
communications; networks of small 
firms; and improved access to and use 
of sources of managerial advice, tech- 
nological expertise and research. Gov- 
ernments should assist small businesses 
in their development, they suggest, 
through seed, venture and equity capi- 
tal, and the financing of debt. 

The Role of the Social 
Safety Net 

The OECD analysts reassert that 
some of the policies intended to pre- 
serve equity have had negative side-ef- 
fects for economies. An example is dis- 
incentives to hiring. The non-wa^^e 
labor costs borne by employers, such as 
social security contributions and taxes, 
represent a large proportion of the cost 
of labor, particularly in Europe. Gov- 
ernments are becoming serious now 
about reducing social spending as a 
way to reduce labor costs and encour- 
age hiring. 

Shifting the tax base from payroll to 
other taxes is one alternative. The re- 
port suggests cutting social contribu- 
tions by employers and employees in a 
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way that favors the hiring of low-wage, 
unskilled labor, such as eliminating 
ceilings on employer contribution rates 
and reducing low-skilled workers * in- 
come taxes. Widening wage differen- 
tials is another option, since there is ev- 
idence this speeds employment growth. 
However, the analysts recognize that 
none of these strategies are simple to 
implement. 

For instance, the down side of wid- 
ening wage differentials is that if these 
become too great, many with low in- 
comes will fall into poverty. In Europe 
and Scandinavia, widening differentials 
are generally unacceptable in terms of 
the commitment to equity. Neverthe- 
less, the report stresses the need to re- 
visit the issue of safety net protections, 
giving more emphasis to “the market- 
clearing role of wages,” and to consider 
new ways to express equity values. 

Many European countries have 
strong employment protection legisla- 
tion, which can reduce hiring and lead 
to the use of temporary work contracts. 
Long-term work contracts encourage 
investment in training and skills up- 
grading, which then increase hiring. 

But finding the right balance between 
worker protections and hiring has prov- 
en to be very difficult. 

The analysts suggest the following 
as important ideas for consideration in 
increasing hiring: 

■ The development of rules to prevent 
major firms from devising barriers 
to entry. 

■ The establishment of rules that pro- 
hibit cartels, while allowing desir- 
able forms of cooperation among 
firms. 

■ International cooperation in moni- 
toring the behavior of firms in- 
volved in international competition. 

Strategies Benefiting Workers 
and Their Families 

The report claims that the typical 
OECD country spends 2-3% of its GNP 
on labor market strategies such as pas- 
sive methods for reducing unemploy- 



ment (example: unemployment insur- 
ance), but they have not shifted much 
of their resources to active strategies 
(example: public employment servic- 
es). The report supports a reconsidera- 
tion of resource use. 

However, on the basis of research 
evidence, the report is critical of train- 
ing programs intended to serve large, 
diverse groups of unemployed — i.e. 
programs that are not carefully target- 
ed. It also questions job creation strate- 
gies that involve subsidized hires. In- 
stead it recommends the involvement 
of all stakeholders in developing more 
effective methods for reducing unem- 
ployment — employers, unions, educa- 
tional institutions, and local govern- 
ments. 

In terms of education and training, 
the report again looks to the research 
evidence: 

a Preschool and early childhood de- 
velopment programs are important 
strategies for providing a foundation 
conducive to the pursuit of life-long 
learning opportunities. 

■ Curricula and teaching methods 
need to be individualized to meet the 
learning needs of underachievers 
and potential school dropouts, if 
they are to acquire workforce skills. 

■ A better balance is needed between 
post-secondary education, and tech- 
nical and advanced occupational 
training. 

B New forms of apprenticeship and 
work-based learning options are 
needed as jobs demand multi-skilled 
workers with general competencies. 

a On-the-job, employer-sponsored 
training should be increased through 
imiovations that will encourage em- 
ployer investment in training. 

■ More effective strategics need to be 
developed to prevent families from 
falling into poverty due to the ten- 
dency for high unemployment bene- 
fits to decrease workers* incentives 
for increasing their hours of work or 
their investment in training. 
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The OECD analysts propose that an 
integration of tax and benefit systems 
may work best, achieved through a 
negative income tax or an income tax 
credit strategy. However they acknowl- 
edge that while this approach may re- 
duce “the poverty trap,” it may not 
raise worker incentives. 

Overall Policy Recommendations 

The report explains the need and ba- 
sis for the recommendations advanced. 

More than ever since World War II, 
today’s unemployment is causing 
damage in ways that cannot be mea- 
sured by the sheer numbers. High un- 
employment creates insecurity and 
resistance to organisational and tech- 
nical change. Long-term unemploy- 
ment lowers self-esteem, is demoti- 
vating and self-reinforcing, and is 
associated with health problems. The 
rise in youth unemployment means 
that many young people are losing 
skills or employability. Groups in so- 



ciety that have never before faced a 
high risk of unemployment, such as 
white collar workers, are losing jobs, 
with ail the personal and societal 
costs that implies in terms of lost po- 
tential and lost investment. 

The broad goals of the recommenda- 
tions flowing from the Jobs Study are 
these: to enhance the ability of econo> 
mies to adjust and adapt, and to in- 
crease their capacity to innovate. Their 
major policy suggestions, excerpted 
from the OECD report are presented in 
Figure 1. 
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For readers interested in keeping in- 
formed about employment and related 
issues in the OECD countries, the ex- 
tensive OECD Catalogue of Publica- 
tions can be obtained at no cost from 
the OECD Publications and Information 
Center at 2001 L St. N.W., Suite 700, 
Washington, D.C. 
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The Persistence of 
Unemployment in 
the Postindiistriaf 
Era 

The Economics Department of the 
Organization for Economic Coopera-, 
tion and Development (OECD) in Paris 
publishes a semi-annual journal, OECD 
Economic Studies. In this article we re- 
view two articles in the Winter 1993 is- 
sue. The first is by Jorgen Elmeskov 
and Maitland MacFarlan, “Unemploy- 
ment Persistence.” The second is “In- 
terpreting Unemployment: The Role of 
Labour-Force Participation” by Elm- 
eskov and Karl Pichelman. 

Elmeskov and MacFarlan 

The most worriesome characteristic 
of unemployment in most OECD coun- 
tries in the 1 990s, the authors propose, 
is its tendency to continue close to the 
level experienced during the worst eco- 
nomic times even in good economic 
times. This has been the outstanding at- 
tribute of the four unemployment cy- 
cles since 1 966. The European Union 
(EU) rate, for example, rose from 6% 
to 10% during the economic declines of 
the early 1980s, and did not go below 
8% in 1 990. The authors seek explana- 
tions for this trend. 

Studying the research evidence, two 
alternative explanations emerge. Persis- 
tent unemployment appears to be relat- 
ed to 1) changes in the deegtr structur- 
al influences that determine the demand 
for and the supply of labor — changes 
that have increased cyclical unemploy- 
ment rates, and 2) the tendency for high 
cyclical unemployment to create struc- 
tural unemployment. 

The authors’ thesis is that the tradi- 
tional distinction between cyclical and 
structural unemployment is dimming in 
the context of two trends: the tendency 
for unemployment related to cyclical 
unemployment forces to develop into 
longer-term structural unemployment, 
and the tendency for the economy’s 
structural characteristics to influence 
the cyclical aspects of economic activi- 
ty. Indicators used to describe unem- 



1. ■ . Major PbHcy Suggestion^ in ihe OECD Report 



Set macroeconomic policy such that it will both encourage growth 
make it sustainable. 



. . and 



Enhance the creation and diffusion of technological know-how by Improvina 
frameworks for Its development. ^ ^ 



Increase flexibility of working-time , 
ployers. 



. voluntarily sought by workers and em- 



Nurture an entrepreneurial climate by eliminating impediments to . . . the ere- 
atlon and expansion of enterprises. 

Make wage and labor costs more flexible by removing restrictions that prevent 
wages from reflecting local conditions and individual skill levels. 

Reform employment security provisions that inhibit the expansion of emolov- 
ment in the private sector. ^ ^ 

emphasis on active labor market policies and reinforce their 

0iI6CtlV6n6SS. 

Improve labor force skills and competences through wide-ranging changes in 
education and training systems. a m 

Reform unemployment and related benefit systems . . . such that societies’ 
fundamental equity goals are achieved in ways that impinge far less on the ef- 
ficient functioning of labor markets. 
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ployment rate trends suggest that the 
unemployment rate required to stabilize 
wage inflation has risen, that vacant 
jobs are filled with greater difficulty 
than before, and that the use of physical 
production capacity is reaching a 
threshold leading to a mismatch be- 
tween jobs and available sources of la- 
bor. Overall, OECD structural unem- 
ployment rose steadily throughout the 
1970s and early 1980s, declining some- 
what in the early 1990s. The authors 
claim, however, that this general pat- 
tern veils important differences across 
OECD countries and regions. 

To study basic causes and the rea- 
sons for differences across OECD 
countries, the authors utilize a particu- 
lar analytical framework to explore the 
phenomenon of rising unemployment. 
The framework gives attention to three 
key relationships: the demand for la- 
bor; the nature of wage-setting; and the 
labor supply. 

These relationships are considered 
to affect the important interrelationship 
between cyclical and structural unem- 
ployment Applying a statistical model, 
the authors empirically test some of the 
major theories explaining persistent un- 
employment in the OECD countries. At 
either end of the continuum of potential 
causes are 1) a rise in natural (cyclical) 
unemployment, and 2) slow adjustment 
to economic change (a structural 
cause). The analysts come to a rather 
nebulous conclusion that neither theory 
is fully conect! This conclusion actual- 
ly has important implications for eco- 
nomic policy, such as those suggested 
in Figure 1. 

The authors make it clear that the 
problem of persistent unemployment is 
quite complex, since there are likely 
multiple causes. Long periods of cycli- 
cal unemployment can dissove into 
structural unemployment. At the same 
time, a common set of policies may be 
effective, they say, in reducing both cy- 
clical and structural problems. For ex- 
ample, structural alternatives may be 
effective in reducing both the natural 
rate of unemployment and slow adjust- 
ment to change such as policies sup- 
porting worker mobility. 



Theories: and ;PolicY;Alternatw • 



Theories Explaining 


Policy Alternatives 


Persistent Unempioy- 
ment 


Microeconomic Options 


Macroeconomic Options 


« Rising natural rats of 


■ Reform directed to 


■ Policies seeking to ex- 


unemployment 


reversing or offset- 


pand the economy. 


■ Slow adjustment to 
economic change 


ting the factors caus- 
ing the rise in and 
persistence of unem- 
ployment. 

■ Reduction of employ- 
ment protections. 

■ Reform directed to 
improving the region- 
al and occupational 
mobility of the unem- 
ployed. 


■ Activist policies. 



On the other hand, reducing employ- 
ment protections may be an efficient 
option for speeding adjustment to 
change but may do little to reduce cy- 
clical unemployment. Expansionary 
macroeconomic policies may have no 
influence on persistent unemployment 
due to cyclic^ factors. Slow adjust- 
ment may have only a minimal effect 
on the natural rate of imemployment. 
Activist policies that attempt to fine- 
tune the economy may be counterpro- 
ductive if they lead to a neglect of 
structural forces. Automatic stabilizers 
would seem to be important in prevent- 
ing sharp economic ups and downs, but 
these may also cause a rise in cyclical 
unemployment which then destabilizes 
the economy. 

The message is that there are consid- 
erable policy risks in misdiagnosing the 
causes of persistent high unemploy- 
ment, and in relying only on one strate- 
gy. The authors suspect that placing 
major policy emphasis on structural re- 
forms may be the most effective deci- 
sion — particularly reforms that im- 
prove the skills of the unemployed and 
offer (hem incentives (o re-enter the la- 
bor force, 

Emeskov and Pichelman 

This article on the role of labor force 
participation in persistent unemploy- 
ment is more understandable by non- 
economists, and likely more useful to 



employment and training professionals. 
It focuses on the relationship between 
labor force participation and reported 
unemployment. The point the authors 
wish to impress cn readers is that the 
measurement of unemployment lacks a 
clear-cut distinction between unem- 
ployment and nonparticipation in (he 
labor force. This, they say, continually 
leads to policy confusion. 

The relationship in question is likely 
to change, the authors suggest, on the 
basis of a number of influences: the de- 
mographic composition of the work- 
force, the extent of coverage and the 
generousness of income support sys- 
tems, and other incentives affecting the 
decision to join or leave the labor force. 
Low unemployment could mean that an 
excess supply of labor is being moved 
toward nonparticipation, which masks 
the true extent of unemployment. 

Trends in Labor Force 

Participation 

Participation rates have continually 
risen since 1970 in all OECD countries 
due almost entirely to the increase in 
female participation. The authors credit 
the gradual shift in cultural and social 
norms and attitudes with this char ge, 
but the change has also been supported 
by the increasing availability of public- 
ly-financed day care institutions in 
many OECD countries. The authors 
feel (he reform of tax systems, particu- 
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larly reforms that made the individual 
rather than the family the basic tax unit, 
may have been another factor. Howev- 
er, long-term trends in participation 
rates have varied across geographical 
areas. For example, male participation 
rates have declined over the past twenty 
years in almost all European countries. 
In North America and Japan they have 
been stable. 

An analysis of the OECD data used 
in studying the relationship between 
participation and unemployment sug- 
gests that the “hidden component” of 
unemployment may increase as mea- 
sured (“open”) unemployment increas- 
es. There is little evidence in the data 
that countries with low levels or in- 
creases in measured unemployment ex- 
hibit these conditions at the expense of 
lower levels of participation, and dif- 
ferences in measured and hidden unem- 
ployment across OECD countries may, 
the authors surmise, be larger than the 
data reveal. 

The authors view data on “discour- 
aged workers” as an important resource 
in understanding the dynamics. This 
group represents n subset of a larger 
group of people who have stopped 
searching actively for employment be- 
cause they have concluded that no via- 
ble jobs exist. Although “discouraged 
worker” definitions vary across mem- 
ber countries, making an analysis of the 
data difficult, over time these data sup- 
port the authors* conclusion from their 
own analyses, namely that official un- 
employment and discouraged worker 
rates are positively correlated — with 
the exception of Japan. The long-run 
relationship between unemployment 
and labor force participation seems to 
be negative. Again, however, there are 
different tradeoffs between these phe- 
nomena for different countries. Coun- 
tries with low unemployment, such as 
Japan, tend to have high participation 
rates. Countries with high unemploy- 
ment, such as Spain, tend to have low 
participation rates. 

Fluctuations In Unemployment 

Using changes in the average annual 
unemployment rate as a measure of 
fluctalions in unemployment over busi- 



ness cycles, the authors find that unem- 
ployment flucUiations — i.e. variability 
in unemployment ~ are greater in 
North America, the UK, Spain and Ire- 
land than in Japan, Austria, Switzerland 
and some of the Scandinavian coun- 
tries. The autliors attribute differences 
in unemployment variability to interac- 
tion between 1) employment and 2) un- 
employment and nonparticipation. 

Acknowledging data inadequacies, 
they take a look at cyclical fluctuations 
in output (“volatility”), which they pro- 
pose may lead in different ways to dif- 
ferent degrees of variation in employ- 
ment across countries, and may 
ultimately generate differing unem- 
ployment conditions. They find that 
countries respond differentially to “de- 
mand shocks, the degree of exposure to 
autonomous supply shocks, the sectoral 
composition of output, and the pres- 
ence of automatic stabilizers.” 

A traditional explanation for the rel- 
ative stability of employment, the au- 
thors ccnclude, is “labour hoarding,” or 
the tendency in economic downturns 
for firms to reduce hours of work be- 
fore laying off workers. Another vari- 
able is employment protection legisla- 
tioHt and incentives embedded in 
unemployment benefit systems. These 
influence economic adjustment costs 
and as a result affect employment flexi- 
bility. Variations in self-employment 
are also an influence. The authors point 
out that as the volatility of self-employ- 
ment drops below that of wage and sal- 
ary employment, a generally high pro- 
portion of self-employment (within 
overall employment) tends to reduce 
the latter's cyclical variability. This is 
an important finding since self-employ- 
ment is growing faster in OECD coun- 
tries than overall non-agricultural em- 
ployment. 

Labor Force Sensitivity 

The analysts also look at the sensi- 
tivity of ihe labor force to cyclical la- 
bor market conditions. In doing so they 
study two phenomena: 

1. The “elasticity** of labor force “trend 

deviations** in employment — that 

is, a measure of labor force respon- 



siveness, or the extent to which the 
effect of fluctuations in cyclical em- 
ployment on unemployment are 
softened by what tlie authors define 
as “procyclical variations** in the la- 
bor force. 

Conclusions from the analysis: Elas- 
ticity varies widely across countries. 
France has almost no short-run labor 
force response to cyclical swings in 
employment, whereas in Japan these 
ups and downs have a significant ef- 
fect. 

2. The “elasticity*’ of labor force partic- 
ipation rates. 

Conclusio ts from the analysis: In all 
OECD c juntries, other than Germa- 
ny and France, total participation 
rates are significantly affected by 
employment rates. And the elasticity 
of participation rates with respect to 
employment opportunities is higher 
for females than for males, and 
higher for youth and older workers. 
This is consistent with the fact that 
the larger proportion of workforces 
in OECD countries are women, and 
they are overrepresented in the dis- 
located worker population. 

Unemployment Utilized as a 
Socio-Economic Measure 

The forces affecting and explaining 
cyclical fluctuations in unemployment 
offer important insights to tliose inter- 
ested in better social and economic in- 
dicators. The autliors define three ma- 
jor roles for unemployment in this 
respect: 

■ Unemployment as a measure of un- 
der-utilization of labor. 

8 Unemployment as an indicator of 
social hardship. 

■ Unemployment as a determinant of 
wage pressure. 

A number of implications identified 
by the authors ?je noteworthy. If ex- 
panding output produces a virile em- 
ployment response at the same time the 
labor force stays the same, unemploy- 
ment tends to fall strongly with rising 
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input — but potential output increases 
as a result of increasing actual output, 
if rising productivity leads to rising em- 
ployment which in turn incieases the 
labor force. This is why countiies with 
a responsive labor force and productiv- 
ity car. expand longer when coming out 
of an economic down cycle prior to in- 
flationary pressures building sufficient- 
ly to require corrective measures. In 
this sense, “cyclical fluctuations in pro- 
ductivity and cyclical labour-force vari- 
ations — and not measured uTicmploy- 
ment — are relevant in gauging the foil 
extent of under-utilisation of labour 
nnd the associated output loss during a 
slowdown/’ 

Using unemployment as a measure 
of social hardship may fall victim to the 
same malady. The authors claim that 
changes in measured unemployment 
underrepresent changes in gainjul em- 
ployment and earned income. Further- 
more, these changes do not reveal the 
amount of economic hardship caused 
by cyclical downturns. Unemployment 
benefits clearly reduce such hardship, 
therefore the hardship is greater for la- 
bor force non-participants since they 
are not officially employed. In coun- 
tries where unemployment benefits are 
reduced substantially as a spell of un- 
employment elongates, the labor force 
tends to respond more to changes in 
employment. 

As an indicator of wage pressui'e, it 
is the authors’ interpretation of their 
data analysis that unemployment rates 
are more useful in explaining wage in- 
creases than labor force participation 
rates. This may be due to the fact that 
different groups of workers react dif- 
ferently to changes in employment. 
Workers in their prime ages are as- 
sumed to influence wage determination 
more than others. Also, workera with 
longer spells of unemployment influ- 
ences wages less than others. 



Overs!! Conclusions 

The authors comment on the evi- 
dence produced in analyzing data and 
on the unsolved mysteries that remain 
(see Figure 2). Two explanations for 
the mysteries are possible, according to 
the OECD analysts: 

1. The relationship described above, 
between labor force responsiveness 
and unemployment may occiju* if a 
country has experienced predomi- 
nantly negative shocks over recent 
decades. 

2. The peraistence of unemployment 
may be greater follovring an upward 
shock to the unemployment rate 
than following a downward shock. 

However, the degree of labor force 
responsiveness does not appear related 
to trends in or levels of labo: force par- 
ticipation. Participation rates tend to 
return to their underlying trends while 
unemployment rates do not. It is no 
surprise that the analysts conclude that 
the complex interactions between un- 
employment trends and economic cy- 
cles will require further research! 
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Remairdng Mysteries 



Cross-country differences are typical 
for trends and cycles In unemploy- 
ment and labor force participation 
across OECD countries, but these dif- 
ferences cannot be attributed to dif- 
ferent participation rates. Unemploy- 
ment rates are only a partial reflection 
of cross-country differences in trends 
and levels of employment 



Countries with volatile unemployment 
rates tend to have larger Increases In 
unemployment ovar long periods 
than countries with unemployment 
that Is more cyclically stable. Since 
labor force responsiveness Is a major 
influence on unemployment volatility, 
there is a relationship between re- 
spon<ilveness and the increase in 
and level of unemployment. This 
does not seem consistent with the 
fact that unomployment tends to re- 
turn quickly to a stable natural Jate of 
unemployment following an oconom- 
Ic snoK K 
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Labor Issues 
in European 
Consolidation 

This short article briefly summarizes 
a 1993 book published by The Brook- 
ings Institutiop, Labor and An Integrat- 
ed Europe, Edited by three Brookings 
economists, Lloyd Ulman, Barry 
Eichengreen, and William T. Dickens, 
the book provides an important frame- 
work for understanding the evolution 
of thinking about a single market for 
the European Union, the changes pro- 
posed to reach such a goal, and the 
probable effects of this consolidation 
for Europe and other countries. We 
confine our attention to the first chap- 
ter, by the editors, on some of the im- 
plications of consolidation for the la- 
bor force and labor market. 

Some Useful History 

The Maastricht Treaty of 1991 was 
to remake the European economy. Eu- 
ropean currencies were to be replaced 
with the “ecu,** a common currency for 
all European Union (EU) countries. A 
European central bai^ was to take pre- 
cedence over the existing banks of 
member nations. Free trade and free 
movement of workers across national 
boundaries within the EU were to her- 
ald a new era. Of the changes to be 
achieved, by far the greatest, according 
to the editors of the Brookings book, 
was the transformation of the European 
labor market. Workers were to be free 
to seek and accept employment in any 
part of the EU. 

The ambitious intentions in the 
Treaty represented eiiormcus challeng- 
es for governments, employers and 
workers. The ':ditors point to these 
three as some of the most difficult to 
meet: 

U Competition among differing na- 
tional systems of workforce prepa- 
ration and social welfare* 

Question: Will the integration pro- 
cess result in unifomt systems of in- 
dustrial and business relationships 
and social welfare, through negotia- 
tions among “major {nstitutioual ac- 



tors in national labor markets,*’ or 
will competition among th^se na- 
tional systems simply increase and 
become divisive? 

2. Changes in the location and com- 
position of production, and their 
effect on employment. 

Questions: Will the integration pro- 
cess alter the traditional segmenta- 
tion of European internal labor mar- 
kets by reorganizing labor market 
sectors and regions across the EU, 
the purpose being to permit firms 
anywhere within the EU that spe- 
cialize in particular products and 
services to locate together to utilize 
concentrations of resources and pur- 
sue economies of scale and scope — 
or will there be resistance to the re- 
location required in developing a 
comprehensive overhaul of econom- 
ic activities? Will European work- 
ers, traditionally resistant to move- 
ment even to new regions within 
their own countries, be mobile 
enough to supply these new points 
of resource consolidation and eco- 
nomic activity with the labor needed 
for such reorganization? 

3. Potential intensification of >oco- 
nomic competition between the 
EU and other countries. 

Question: Given the prediction by 
experts that European integration 
will increase the productivity of 
member nations and their x^verall 
competitiveness, will the EU pene- 
trate outside markets previously 
dominated by others and limit the 
acce.,s of other countries to the EC’s 
market, with negative consequetices 
for the U.S. and other nations, par- 
ticulariy Eastern and Central Europe 
and the former Soviet Union? 

The Evolution of European 
i.^togration 

The 1957 Treaty of Rome moved a 
laige number of European nations in 
the direction of freeing up import du- 
ties and quota restrictions on interna- 
tional trade. But this did not translate to 



much progress in integrating markets 
for services, capital or labor. In the 
1970s, the nations of Europe were pre- 
occupied with domestic problems and 
integration efforts slowed. High inter- 
nal unemployment and low economic 
productivity consumed their intellectu- 
al and political energies. But the reality 
of rising unemployment and continuing 
lackluster productivity renewed Euro- 
pean Interest in the reorganization of 
resources and labor forces, under the 
assumption that excessive intra-nation 
regulation was largely to blame. 

The editor’s report that the 1987 Sin- 
gle European Act was expected to es- 
tablish a common market for products, 
capital and labor by 1992. Physical and 
technical restrictions on international 
economic activities were finally to end. 
The Act required European Community 
members to 1) remove trade barriers, 
and 2) eliminate domestic policies that 
seemed to inhibit intra-EC competition 
— that is, to develop a truly integrated 
market for capital and labor as well as 
for products and services. However, 
there were serious questions about the 
potential for some countries within the 
EC to erode others’ competitive edge, 
or to seek out cheap labor in another 
EC nation leading to more unemploy- 
ment. Consequently in 1989 a Social 
Charter was established which guaran- 
teed minimum standards of compensa- 
tion and welfare throughout the EC, 
through mechanisms such as EC-wide 
labor and management institutions. 



Unions 

Analyses indicate, the editors say, 
that market integration in the EC 
spa'^vns both centralizing tendencies 
and decentralization^ as has been the 
case in the U.S. In the U.S. the creation 
of an Integrated market across states in- 
creased Centralized collective bargain- 
ing as unions advocated for more uni- 
form wages and labor costs. Later there 
has been a decentralization movement 
in which unions have lost membership. 
The EU is not likely to experience as 
strong a decentralization tendency, the 
editors suggest, because of the tradi- 
tional strength of European “employ- 
ers* associations, mandatory works 
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council elections, effective deterrents to 
strike breaking, the representation of 
unions in public administration and on 
labor tribunals, and the legal restriction 
of certain benefits to union members.” 

Worker Participation in 
Management 

The Social Charter proposed that 
workers be infused into management 
decisions. This actionrWas thought to 
strengthen employer associations and 
unions if it were initiated by employ- 
ers. However, it was acknowledged that 
increased worker participation some- 
times eroded union power if initiated in 
the context of weak unions. Both em- 
ployers and unions have problems with 
this component of the Charter. German, 
Belgian, Dutch and Danish workers, for 
instance, have supported employee in- 
formation, consultation and participa- 
tion because there is a common em- 
ployer-employee commitment to the 
application of high standards to low- 
standard EU countries. On the other 
hand, French labor has not supported 
this part of the Charter. 

Some experts writing in the Brook- 
ings book recommend industrial rela- 
tions systems which do not restrict or 
unduly limit worker participation and 
labor-management cooperation. There 
is some agreement that centralizing 
tendencies will ultimately dominate 
over “national differences in industrial 
relations traditions and institutions, in 
union organizational strengtli, and in 
union attitudes concerning tne desir- 
ability of uniform EU-wide labor stan- 
darls. 

Other analysts in the book make the 
important point that a significant condi- 
tion for successiul economic competi- 
tion is “long-term employment rela- 
tionships that encourage investments in 
training skilled and versatile workers.” 
They look to the German industrial rey 
• lations system as a model for a unified 
Europe that is economically viable. 

Worker Mobility and Protection 

A major question about EU inten- 
tion in the minds of the analysts writing 



in the Brookings volume is whether 
pension and health benefits reduce 
needed worker mobility. In the U.S., 
workers with health problems find it 
difficult to change jobs because of the 
potential loss of health coverage. In 
Europe, health coverage mandated by 
national governments remove this bar- 
rier to the movement of labor. The re- 
search seems to confirm that national 
social security mandates appear to in- 
crease mobility. So if this is the case, 
the lower mobility in the EU must, the 
experts suppose, be due to other fac- 
tors, such as historical and cultural dif- 
ferences. 

According to the book^s editors, re- 
moving barriers to labor mobility will 
require a common policy regarding 
workers migrating into the EU from 
other countries. There will be strong 
pressure, they say, to negotiate an EU- 
wide compromise between “rotation 
policies [Germany, as an example] and 
permanent immigration restrictions [as 
for example, in Sweden].” They con- 
clude that the rotation approach is most 
feasible, inasmuch as an immigration 
policy that is too restrictive could in- 
crease mismatches between skills and 
job, leading to more unemployment. 

The Effect# of European 
Integration on Other Countries 

Although the book’ s experts do not 
see a significant negative economic ef- 
fect for the U.S. in the integration of 
European economic activity, they are 
concerned that emerging Eastern Euro- 
pean nations could suffer considerably 
from restrictive EU immigration poli- 
cies and a lack of access to Western 
European export markets. If economic 
restructuring and dislocation concen- 
trates in regional pockets of high unem- 
ployment, this could lead the EU to 
adopt protective measures that would 
be damaging to Eastern Europe and the 
former Soviet Union. The latter, the an- 
alysts say, would be counterproductive 
for Western Europe in the long run. 



Political Economy of 
“Borrowing” 

Issue #9 of Evaluation Forum fea- 
tured a series of articles on the new em- 
ployment and training system adopted 
by the United Kingdom (UK) under 
Prime Minister Thatcher — Ae Train- 
ing and Employment Council (TEC) 
system. This new initiative privatized 
tlie government’s effort to provide edu- 
cational, occupational training and em- 
ployment services to workers consid- 
ered in need of a range of assistance. 

The series ofarticles included an ex- 
planation of the elaborate evaluation 
system designed to study the imple- 
mentation and performance of the TEC 
system. 

This article analyzes some of the un- 
derlying features of the U.S. and U.K. 
approach to investment in employment 
and training. It is based on a Brookings 
Institution book published in 1993 and 
edited by David Finegold, Laurel Mc- 
Farland and William Richardson, 
Something Borrowed, Something 
Learned: The Transatlantic Market in 
Education and Training Reform. Fine- 
gold is a political scientist and educa- 
tion specialist who was involved in the 
development of the TEC system and its 
evaluation strategy as a faculty member 
of Wanvick University in the UK, and 
is currently at the Rand Corporation in 
California. McFarland is an economist 
who was at the Brookings Institution 
when the book was written. Richardson 
is a senior research fellow at the Centre 
for Education and Industry at the Uni- 
versity of Warwick. 

The Theme of the Book 

The editors reveal their interesting 
antiiropological theme in the introduc- 
tion to the book. They begin with the 
premise that education and training 
policy in the US and Great Britain con- 
verged in the late 1980s, both countries 
becoming more dependent on each oth- 
er’s ideas. They claim that extensive 
borrowing, reshaping and application 
of each other 's employment and train- 
ing ideas took place in the 1980s, high- 
lighting the influence of JTPA on the 
British system. Their analysis of the 
reasons for this borrowing and Its iin- 
plications for policy is tightly packed, a 
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well-organized and clearly-written sort- 
ing out of major influences and effects 
which ties their conclusions closely to 
expert opinion and empirical evidence. 

pie economic context of the analy- 
sis is two-fold. Their major emphasis is 
on general economic change in the 
postindustrial period. Such change, 
they say, has been the main influence 
on contemporary employment and 
training reform in all advanced iadus- 
trial nations. They point to the integra- 
tion of world markete, to technological 
change, and to increasing anxiety about 
sustained economic progress as charac- 
teristics which differentiate this period 
from the continuing economic growth 
and relative stability that defined the 
period between World War II and the 
oil crisis of 1973, and constituted a 
stimulus for reform. But they do not ig- 
nore important US borrowing from 
Western Europe. Their conclusion is 
that such transnational borrowing will 
likely increase in the future, as the 
world’s academic and political commu- 
nities become increasingly internation- 
alized due to growing economic com- 
petition and greater interdependence 
among industrialized economies. 

pe second significant focus of tlie 
book is on differences between US and 
British reforms, and those of these 
countries' main international competi- 
tors. In this respect, the editors are in- 
terested in the “shared context of rela- 
tive economic decline” — that is, the 
structural features of the two econo- 
tnies that have discouraged the adop- 
tion of high-skill, higli-performance 
strategies, and the comparatively low 
levels of education and training provid- 
ed by both. But they see important dif- 
ferences between the US and Britain as 
well, that tilt the US further than the 
UK toward high-skill enterprises. 

In 1976, Britain’s prime minister 
criticized the UK’s employment and 
training system for failing to respond 
adequately to the needs of industry, and 
launched a series of reforms. The 1983 
report Nation At Risk served a similar 
purpose in tlie US, and was subsequent- 
ly supported by Worlforce 2000 reports 
in 1987 and 1990, and by Investing in 
People in 1989. Faced with declining 
affluence, the two countritss’ emphasis 
on skills gaps, and the quality and 
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quantity of outputs from their employ- 
ment and training systems, was a strong 
energizer for change. At the same time, 
pressures for educational change were 
endemic throughout Europe — even in 
Japan and South Korea — reinforcing 
these change efforts. 

Common Characteristics, 

But Differences as Weii 

More generally, the editors see com- 
mon economic forces driving employ- 
ment and training reform in all indus- 
trialized nations over the 1980s. Rapid 
technological change and the interna- 
tionalization of capital generated more 
intense political scrutiny of employ- 
ment and training systems — the ade- 
quacy of the skills they produced, and 
their overall efficiency. Under such 
scrutiny, the US and the UK displayed 
common characteristics: declining com- 
petitiveness in world markets and low 
skill demands by employers; a lack of 
cooperative strategies and institutions 
for sharing the knowledge and cost re- 
quired to develop and implement high- 
skills programs; and high drop-out 
rates in secondary education and low 
participation in postsecondary educa- 
tion and training. 

The two countries also share a com- 
mon view of government’s role in solv- 
ing such problems, the editors suggest, 
such as the emphasis on voluntarism 
(allowing tlie market to stimulate the 
provision of training) and weak corpo- 
rate-government arrangements. Added 
to ail these similarities are historical 
linquistic, cultural and governmental 
commonalities that were strengthened 
in the 1980s by the political ideologies 
of Reagan and Thatcher, which stressed 
tlie need to free market forces from un- 
necessary government control, cut tax- 
es, reduce union influence, and Increase 
consumer choice in education and 
training. 

These shared attributes are not tlie 
full story, however. In die US, the edi- 
tors propose, higher education is seen 
as m investment most families and in- 
dividuals should be willing to make; in 
the UK it is viewed as a ri^t of citi- 
zenship, therefore the government un- 
derwrites tuition for the smaller group 
of students involved, Also, the larger 
size and the more complex nature of 



the American underclass creates unique 
problems. The editors view the stronger 
role permitted the central government 
in the UK in reforming education, 
training and employment systems as the 
most significant difference betiveen the 
two countries. 

It is such differences that complicate 
the transfer of policy between the two 
countries, the editors say, and may ex- 
plain some of the unintended conse- 
quences of borrowing. The greater the 
differences, they contend, the more 
general and abstract the policy transfers 
should be, if they are to be useful and 
productive. 

Transplantation 

The editors’ main fascination is with 
the effect of differing social, economic 
and political contexts on transplanted 
policies — that is, whether particular 
policies and programs can work in iso- 
lation from the system that created 
them, much like an organ transplant, 
and how transplantation may alter the 
original idea. A case in point is the UK 
borrowing of the JTPA Private Industry 
Council (PIC) concept, making greater 
demMds on the British employer com- 
munity than JTPA makes on American 
employers, even though the research 
evidence has suggested that the effec- 
tiveness of PICs was questionable. The 
Training and Enterprise Councils 
(TECs) are now encountering problems 
similar to those faced by PICs, such as 
the maintenance of employer leadetship 
at the top levels of management, and 
the development of performance indi- 
cators. It is not yet Imown whether the 
distribution of central government 
training dollars directly to employer-con- 
trolled TECs will work, given difference.') 
between Great Britain’s and the US’s 
cost reduction goals, national income dis- 
tributions, tax systems and approaches to 
private sector risk assessment 

The direction of British borrowing is 
chan' ting with John Major’s tenure, and 
the g.owing emphasis on European 
Union status, the editors observe. The 
policy exchange ippcai's to be giving 
greater emphasis to EU education and 
training models, although tliey feel tliat 
broader, more wide-ranging borro ving 
is Ukoly to occur on the part of all In- 
dustrial nations In the ftiture. Mean- 
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while, the UK/US linkage is too strong 
to preclude continued sharing of policy 
concepts. The editors say that “British 
conservatives remain covetors of the 
U.S. labor market’s capacity to create 
jobs and convince individuds to invest 
in their own education and training.” 

At the same time, the US has become 
intrigued with Britain’s approach to na- 
tional assessment, school-to-work tran- 
sition programs and experiments with 
educational vouchers. 

r*inegold'« Perspective on the 
Economics of “Borrowing” 

There is so much of interest in the 
various chapters of this fine book, a 
thorough review must of necessity ex- 
tend beyond this issue of Evaluation 
Forum. In this issue we focus more nar- 
rowly on David Finegold's intriguing 
chapter on “The Changing International 
Economy and Its Impact on Education 
and Training.” 

Finegold’s interest is in the econom- 
ic context of the heavy borrowing that 
he claims occurred between the UK and 
the US in the 1980s. Within that con- 
text he addresses three issues; 

1. Economic change as the major influ- 
ence in stimulating employment and 
training reform in all advanced in- 
dustrial nations since the mid-1970s 
— particularly the integration of 
world markets, technological change 
and growing mxiety about econom- 
ic health. 

2. The two countries’ common envi- 
ronment of “relative economic de- 
cline” ■ — with an emphasis on the 
structural characteristics of their 
economies that have resisted the de- 
velopment of high-skill initiatives, 
such as their low level of education 
and training. 

3. The differences between the two 
countries that provide the US with a 
greater capability to create and sus- 
tain high-skill economic activity. 

Economic Change 

The period between the end of 
World War II and the 1973 rise in oil 
prices was one of sustained economic 
growth and relative stability, signifi- 



cantly different from the international 
competition that characterizes the 1990s. 
\Wthin the new competitive environment, 
Finegold views the increasing interde- 
pendence of industrial economic ^ the 
most dramatic change. Less striking but 
nevertheless influential is the growing 
importance of international trade, par- 
ticularly among the developed coun- 
tries and regarding services. 

Joint cross-country economic ven- 
tures have grown enormously. In the 
three-year period between 1985 and 
1988, 400 alliances between American 
and European corporations have been 
created, 150 ^tween European and 
Japanese firms, more than 200 between 
Japan and US companies. Also, the in- 
ternationalization of capital has stimu- 
lated cross-national hi^-technology 
development. The establishntent of the 
EU and Ae signing of NAFTA have 
supported the integration of world mar- 
kets further. 

These developments, Finegold says, 
have moved the industrial giants away 
from “export-driven, nationally-cen- 
tered companies” to a new phase direct- 
ed by global competition and global 
corporations. In this new economic en- 
vironment there are formidable new 
competitors for the world’s capital and 
goods: in particular Japan, but also 
Hong Kong, Singapore, Taiwan and 
South Korea. These new entrants into 
the world market scene, Finegold be- 
lieves, are “moving rapidly into higher 
quality, higher value-added market seg- 
ments once dominated by the US and 
Western Europe.” To explain the impli- 
cations of these changes, Finegold sum- 
marizes Robert Reich’s analysis thus: 

As the major factors of production 
(capital, technology and raw materi- 
als) move more freely and quickly 
across national boundaries, labor, the 
least mobile factor, becomes a more 
central component of firms’ search 
for competitive advantage. Since the 
advanced industrial countries cannot 
compete with developing countries 
on the basis of labor cost, tlie surviv- 
al of their manufacturing base — and 
the vast array of services which sup- 
ports it — depends upon superior la- 
bor quality hence the skills of 
curreftt and fhture employees. 



Technoiogicai Change 

It is thv apid evolution of micro- 
electronics and irtformation technolo- 
gies that Finegold cites as the major 
change, in that this evolution has al- 
tered what is sold in the new market 
and how goods and services are pro- 
duced. The new technolo^es, he says, 
allow companies to respond within a 
short timeframe to shifts in customer 
demand. Forcing rapid restructuring, 
these breakthroughs have reoriented 
manufacturing approaches and reorga- 
nized manufacturing processes. They 
have also demanded new kinds and lev- 
els of worker skills. As companies have 
moved in this direction, fewer manual 
workers have been needed, Finegold 
points out, and higher skills have been 
in demand for the workers retained. 
However, he makes it clear that techno- 
logical chMge does not ah\iqys lead in 
tills direction. Managere are free to d^ 
cide whether to economize and upskill, or 
to increase managerial control and reduce 
the skiU level of their workforces. 

Seonomic Restructuring 

The oil crises in 1973 and 1980 pro- 
duced deep recessions, and increased 
unemployment and inflation. In addi- 
tion, firms found themselves awash in a 
more uncertain economic environment 
filled with many changes. All of the in- 
dustrialized economies felt “compelled 
to restructure. ’’ Finegold says. A major 
restructuring objective was the creation 
of greater flexibility — for firms, for 
workers. This new flexibility was to en- 
courage more rapid adjustment to eco- 
nomic change. It was played out in 
more interest in improving the school-- 
to-work transition, in more high-tech 
training, and in greater attention to up- 
skilling and career redirection for 
workers dislocated by restructuring 
economies. 

Early production systems, with their 
large semi-skilled workforces, perform- 
ing a narrow range of work assign- 
ments on machines confined to those 
purposes, were being abandoned for 
more specialized “niche systems” that 
are able to rush the development and 
production of new goods and services 
to meet rapidly emerging consumer de- 
mands and opportunities. The Japanese 
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Many American ET experts have been surprised and confused 
to learn that Margaret Thatcher looked to their country for policy 
ideas. They are surprised because they tend to view the British 
education and training system as relativejy successful; they are 
confused because, in the United States, the ET system’ is widely 
considered to be in such a state of crisis that no nation would 
want to emulate it. For observers of the British scene, these 
American problems will seem familiar: significantly lower levels of 
attainment in reading, math, and science compared to its main 
international competitors; high drop-out rates in secondary 
schools, particularly in the inner cities; and growing skills 
shortages in specific industrial sectors. Ironically, it is the 
common institutional setting of these problems, rather than any 
record of success, that may explain the affinity between the two 
countries’ policymakers. 

David Rnegold, Laurel McFarland, and William Richardson 
in Something Borrowed, Something Learned 



were first, Finegold says, to create such 
“just-in-time production systems” 
which used coordinated supply chains 
and close monitoring of consumer atti- 
tudes and preferences. These yielded 
substantial savings on inventories while 
achieving a high level of market re- 
sponsiveness. However, Finegold qual- 
ifies the movement toward greater flex- 
ibility, pointing out that companies in 
the advanced industrial nations have 
pursued flexibility in different ways. 

Some firms, he says, have focused 
on cutting fixed costs, reducing their 
full-time workforce through the use of 
part-time or temporary workers, and ty- 
ing wages more directly to worker per- 
formance through profit sharing, bo- 
nuses, Employee Assistance Plans, and 
other strategies. Other companies have 
emphasized decentralizing control over 
the work process to frontline workers 
A^ho are multi-skilled. Relevant to this 
strategy, Finegold disUnguishes be- 
tween measures involving multi-jA77/- 
ing vs. multi-/ay/rf«g^. The former in- 
volves increased worker responsibility 
and enhanced skills for those absorbing 
new technologies or production process- 
es, The latter involves the simultaneous 
performance of a number of tasks that are 
at a comparable skill level, 

Low-skill flexibility strategies, he 
says, reduce costs through dependence 
on cheaper labor, and through reigning 
in the size of the workforce. For com- 



panies hunting high value-added mar- 
kets, high-skill flexibility strategies 
provide significant advantages, such as 
better product quality, a reduction in 
downtimes, and the encouragement of 
continuous innovation. 

Different firms make varying judg- 
ments about the cost/benefit tradeoffs 
of these two general strategies. These 
judgments, the author says, are influ- 
enced by the interdependence between 
“corporate/product strategies, compe- 
tence requirements, and the employ- 
ment and training [ET] system.” For 
example, managers may be less apt to 
invest in their own ET if the message 
from the labor market is that companies 
are organized in ways that preclude re- 
wards for higher skills. Managers may 
well make choices based on the exist- 
ing level of ET and on the institutional 
environment they are in. In Germany, 
says Finegold, the high quality ET sys- 
tem generates innovation because man- 
agers understand they must organize 
the work process such that workers 
continuously have opportunities to 
learn and use new skills — • the sanction 
being that they will be absorbed by the 
competition. 

Institutional Impediments to 
Investment In Employment 
and Training 

Finegold’s message is that the US 
and UK evidence less investment In 



employment and training than do other 
industrial countries, which tends to dis- 
courage the development of high-skill 
strategies.This conclusion is not meant 
to ignore common factors across na- 
tions that affect skill requirements. 
Amcng such factors, the author high- 
lights _/?m size, the nature of the pro- 
duction process, and the type of mar- 
kets involved. Even those countries 
encouraging high-skill strategies evi- 
dence aberrations. In Japan, multina- 
tionals subcontract with firms provid- 
ing considerably lower wages and less 
job security. In Germany, a core of 
highly trained, strongly urionized 
workers co-exists with a migrant labor 
force. Nevertheless, Finegold’s interest 
is in what disincentives exist institu- 
tionally and otherwise in the US and 
UK that have discouraged the march 
toward high-skill, high-wage manageri- 
al practices. These are the major influ- 
ences Finegold outlines in analyzing 
comparative data. 

■ In Britain and the US, the majority 
of individuals leave compulsory ed- 
ucation with a relatively low level of 
knowledge and skill attainment, par- 
ticularly in math and science — in 
fact, they rank at the bottom on the 
latter. 

♦ In England, there is also a high 
dropout rate prior to the comple- 
tion of compulsorj' school. Only 
one-third of the age group 16-18 
remains in school or college and 
less than 1 8% go on to higher ed- 
ucation. 

♦ In the US, ilis vast majority of 
students remain in school until 
age 18, and approximately one- 
half of this age cohort continues 
into some form of higher educa- 
tion. 

♦ The US high school diploma in- 
volves no assessment of the 
knowledge or skills attained, and 
the route into vocational training 
for the non-coUege-bound is ob- 
scure. 

• Students leaving the educational 
system In the US and UK may not 
close the skills gap in these modem 
economies. 
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4 > One-fourth of British manufac- 
turing companies reported in 
1988 that they lacked skilled work- 
ers. Teaching and nursing were ex- 
periencing the same deficits. 

a US and UK managers do not de- 
mand as high a level of skills on the 
part of the average worker as in oth- 
er industrial nations. 

♦ Studies find that both managers 
and workers are poorly trained. 

♦ West German hotels, for exam- 
ple, had 65% higher labor pro- 
ductivity than Great Britain, re- 
lated to the greater quality and 
quantity of training of German 
frontline staff and supervisors. 

■ US and UK firms introduce new 
technologies as ways to reduce costs 
and improve efficiency, rather than 
to enhance frontline workers’ skills, 
make the workplace more flexible, 
or position workers to utilize re- 
search breakthroughs to enhance 
products or services. 

Using a particular analytical frame- 
work, Finegold draws insights from the 
UK and US experience in ET invest- 
ment. The interdependence of three ma- 
jor players in maldng investment deci- 
sions forms the core of tliis framework 
— the three being company manat ' 
government policymakers, and individ- 
ual workers. Another factor, the institu- 
tional setting, tips the scales in the de- 
cision to invest or not invest in ET, 
according to the author. Emphasized 
are two characteristics of high-level 
skills: the length of the period prior to 
realizing a benefit from an investment 
in ET, and the various correlates of the 
decision to invest. Within these at- 
tributes, these are the factors Finegold 
concentrates on: 

L The Short-Term Outlook of the 
US and UK 

Finegold maintains that a long-run 
strategic perspective is more conducive 
to investment in ET because of the high 
cost and deferred nature of the returns on 
this investment However, three structural 
elements of the UK and US economies 



support a short-term approach. 

■ The two countries’ top management 
echelons look more to the stock 
market than to the banking system 
as the primary source of financing, 
because of secxirity laws. Financial 
market analysts focus on easily ac- 
cessible company performance 
measures, such as quarterly earnings 
and revenue, which support a short- 
term view. American executives 
give highest priority to the increase 
in share prices. Japanese managers 
emphasize market share. 

■ The sheer number and size of hostile 
corporate takeovers in the US and 
UK in the 1980s further reinforced a 
focus on short-term results. Govern- 
ment regulations and ownership 
structures in Japan and Germany 
preclude such takeovers. 

■ The organization of firms into “cost 
and profit centers,” and the reliance 
on traditional accounting methods, 
discourage measurement of the less 
tangible benefits of skills upgrading, 
giving training a low priority among 
managers. 

■ Occupational trainers themselves are 
accorded low status and are often 
poorly trained and remunerated, mak- 
ing training vulnerable to cost cutting. 
Japanese and German companies have 
made skills development an integral 
part of corporate structures, using eco- 
nomic downturns as an opportunity to 
increase training, and entering upturns 
with the advantage of better-trained 
workers. 

■ The electoral cycles in the US and 
UK mediate against a long-term per- 
spective. 

■ In the US , the general decentraliza- 
tion of educational decisions to 
states has moved policymakers away 
from strategic planning involving 
training* Central governments in the 
UK and the US have focused on dis- 
advantagement rather than on high* 
er-level skills acquisition. 



2. Inadequate Educational 
Approaches 

■ Both countries provide few incen- 
tives to students to invest their time 
and effort in ET. 

■ The U.S. labor market does not re- 
ward high school effort. The UK’s 
elitist examination structure “brands 
the vast majority of students as fail- 
ures.” 

■ Employers attach little importance 
to education-based vocational quali- 
fications, and apprenticeships are 
limited to a minority of students. In 
Japan and Germany, all students 
have incentives available to boost 
their work effort in compulsory edu- 
cation because their performance is 
directly related to their future occu- 
pational opportunities. 

3. Relative Ease ofHiring and Firing 

■ US and UK models and le*ws dis- 
courage a linking of job security to 
the acquisition of skills. The labor 
market is the main impetus for the 
individual’s choice to obtain more 
training. German labor law and the 
Japanese “lifetime employment” 
model accomplish that linkage. 

■ The US provides strong incentives 
for individuals to invest in further 
education following high school. 
More high school students continue 
into higher education than in any 
other advanced industrial nation in 
part because of the value employers 
place on formal degrees and open 
access to higher education. The Brit- 
ish exam system essentially rations 
higher education opportunities. Wage 
differentials between the skilled and 
unskilled are not great enough to in- 
terest those not in college in occupa- 
tional training. 

■ Both countries have failed to design 
”a clearly defined, high-status struc- 
ture of vocational qualifications that 
would help motivate mdividuals to 
obtain training, as in Germany ” 
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4» Absence of Institutional Struc* 
tures and Processes to Foster 
Cooperation 

ft The lack of formal structures and 
processes in both countries erodes 
interest in the mutual benefits of co- 
operation, such as those gained 
through information sharing, the co- 
ordination of activities, joint financ- 
ing of training, the clustering of spe- 
cialized businesses and industries, 
and the development of employer 
organizations. 

ft Cooperation between managers and 
policymakers is weak, leading to an 
over-emphasis on job-specific train- 
ing at the expense of general skills, 
and on the inability to keep pace 
with technological change. 

The Anglo-American stress on 
“voluntarism” leaves training deci- 
sions to managers and their employ- 
ees. This reduces an exchange of in- 
formation between government and 
key producers which is critical in 
encouraging ET investment in 
transferable skills. Connections be- 
tween government, unions and em- 
ployer organizations in the US and 
UK ranked last in a study of eight of 
the largest capitalist economies in 
their ability to formulate and imple- 
ment consensual labor market and 
industrial policies. 

■ The industrial relations arrange- 
ments in the US and UK have dis- 
couraged managers from pursuing 
the acquisition of high-level skills 
on the part of workers. Britain’s 
craft unionism has interfered with 
the reorganization of work and in- 
vestment in new technologies, which 
are needed to support a high-skill 
flexible strategy. In the US, the 
weakness of organized labor and the 
absence of protective legislation en- 
suring employee’s rights has al- 
lowed managers to design corporate 
restructuring with little concern for 
skill levels* 



5, The Lack of Sustained Pressure 
to Innovate 

■ The large size of the US domestic 
market and historically low depen- 
dency on experts has supported slow 
adaptation to changes in world com- 
petition. The UK is more integrated 
into the world economy but has trad- 
ed mostly with developing coun- 
tries. And the UK has insulated cer- 
tain economic sectors from 
competition, contributing to eco- 
nomic decline. 

The Author’^ Conclusions 

Finegold’s position is that the UK 
and US cannot any longer avoid inter- 
national competition and its implica- 
tions. A decade of market-oriented pol- 
icies, such as privatization and 
dere^Iation, in the context of the in- 
creasing integration of markets 
throughout the world demand that these 
countries match or outdo the high-skill 
competition. So both countries are rec- 
ognizing the need to improve their ET 
systems. But Finegold is not all that op- 
timistic. Even if the attainment level of 
students is raised significantly, too 
many other features mediate against 
major ET reform, he concludes. He be- 
lieves that these other influences may 
discourage key actors in bo'^h countries 
from investing in higher-level skills de- 
velopment. 



Editor’s Note 



David Finegold is the author of Edu- 
cation, Training and Economic Compet- 
itiveness, published by the UK’s Oxford 
Press in 1 993. He has also written in 
the Oxford Review of Economic Poiicy 
and contributed to intemationai Com- 
parisons of Vocational Education and 
Training for International Skills edited 
by P. Ryan In 1 991 . William Richard- 
son’s most recent book, on the reform 
of post-1 6 education and training In 
England and Wales, is co-edIted with 
David Finegold. Laurel McFarland has 
written numerous articles on the econo- 
mics of postsecondary education and 
has been Involved In several compara- 
tive education projects sponsored by 
the National Academy of Sciences and 






the Organization for Economic Cooper- 
ation and Development. 

For more Information about the Brit- 
ish TEC system, the UK Employment 
Department produces an Interesting, in- 
formative series of reports titled Re- 
search Series, many of which analyze 
TEC activity. The Research Manage- 
ment Branch of the Department also 
produces the series Individual Commit- 
ment to Learning and Investors in Peo- 
ple. 

Another useful reference is a recent 
book by Bennett, Wicks and McCos- 
han. Local Empowerment and Business 
Services: Britain's Experiment with 
Training and Enterprise Councils, pub- 
lished by UCL Press, Ltd. in 1994. 

The following is a sample of relevant 
reports In the Employment Depart- 
ment's Research Papers and Training 
Research and Development reports: 

Boreham, N. and T. Arthur, Information 
Requirements in Occupational Deci- 
sion Making, University of Manches- 
ter, 1993. 

Crowder, M. and K. Pupynin. T^e Moti- 
vation to Work, Minds at Work. 

1993. 

Ernest and Young. TEC Participation in 
National Development Activity, 

Marchington, M.et al. New Develop- 
ments in Employee Involvement. 
Manchester School of Management. 
1992. 

Pearson, I. The Role of Evaluation in 
TEC Planning. WMEB Consultants, 

1994. 

Pupynin, K. and M. Crowder. Regional 
Advice Unites: An Examination of 
Models for Delivering Advice and 
Guidance to TECs and Department 
of Employment Regional Offices. 
Minds at Work, 1994. 

Rlx, A. et al. Investors in People: A 
Qualitative Study of Employers, 

CRG People at Work, 1994. 

Taylor, S. and L. Spencer. Individual 
Commitment to Lifetime Learning: 
Individuals' Attitudes. Social and 
Community Planning Research, 

1994. 

Vaughan, P. TECs and Employers: 
Developing Effective Links, Employ- 
ment Department, 1993. 
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Economic Reform in the Former Soviet Union 




In the Interviews Section of this Is- 
sue of Evaluation Forum, we feature an 
interview with Salvatore Zecchini of the 
OECD concerning current economic 
and employment policies and their con- 
sequences in Central and Eastern Eu- 
ropean countries and the now-indepen- 
dent republics of the former Soviet 
Union. In this part of Issue #11 we fo- 
cus on the former USSR through a se- 
ries of articles on pre-Stalin, pre-Yeltsin 
economic reform efforts. These reforms 
constructed an Important foundation for 
the economic reform debates continu- 
ing in the separate republics, and in 
particular in Russia. 

■ ■ 

A Selective Overview 
of Soviet Economic 
Reform Policies 

In this article we selectively review 
an informative Brookings Institution 
book by Edward A. Hewelt published 
in 1988 — Reforming the Soviet Econ- 
omy: Equality versus Efficiency, A se- 
nior fellow in the Foreign Policy Stud- 
ies program at Brookings, Hewett’s 
analysis of the pre-Gorbachev and Gor- 
bachev reforms provides useful insights 
about the Soviet experience in revital- 
izing and restructuring its economy. 
Hewett’s main message is that while 
the Stalinist system was successful in 
achieving industrialization and secur- 
ing social and economic equity, it was 
not suited to the ongoing management 
of a mature and increasingly complex 
industrialized economy or to the 
achievement of economic efficiency. 
Relr-ant to this viewpoint, the follow- 
ing u^cerpt from his book is enlighten- 
ing: 

Lenin's vision of the first, socialist, 
phase of communism was powerful 
in its simplicity. He foresaw a system 
In which workers . . . would cnihusi* 
aslically pilch in to produce for each 
other, distributing the fruits of their 
labor fairly and equally. The manage* 



Why should American educational, 
training and employment professionals 
and evaluators want to know about 
economic reform ideas in these post- 
socialist countries? It is understand- 
able that our first priority must be a bet- 
ter understanding of our own economic 
system and workforce. But in the past 
this logical emphasis has tended to iso- 
late us from the experiments of other 
industrialized nations. This singularity 
of focus is changing rapidly. The Ameri- 
can literature on employment and train- 
ing is now filled with insights from 
Western Europe, Japan, and the re- 
structured nations of Central and East- 
ern Europe and the former Soviet 
Union. In the context of a major shift 



ment of that system . . . would not 
prove an onerous burden, given the 
educational level of the labor force 
and the smooth operation of systems 
inherited from capitalism. Socialism, 
for Lenin, was the marriage of the ef- 
ficiency of capitalism and the equity 
so fervently sought by generations of 
socialists. . . . Now, seven decades 
after the Russian Revolution, Soviet 
leaders are still searching for a for- 
mula that will make that “marriage” 
work. They have a system that can 
boast many successes, most notably 
in achieving some of the equity goals 
of fundamental importance to Lenin 
and his Bolshevik party. The stale, 
virtually the sole employer, has a tre- 
mendous appetit** r labor. Thus the 
USSR has almooi no involuntary 
unemployment, still one of the main 
sources of waste and human misery 
in much of the capitalist v/orld. . . . 

This is the ultimate “welfare slate.” 

... It is the efficiency side of the 
marriage that has not gone at all well. 

Pressures for economic reform in the 
direction of a market economy have 
been the legacy of this dilemma, but 
such reform remains a quandry. Well- 
functioning market-oriented economies 
are dependent on economic efficiency 
and competition for customers. These 
economies can be ruthless in punishing 



from manufacturing to services and in- 
formation in postindustrial countries, 
and with the internationalization of eco- 
nomic competition, we clearly rieed a 
broader canvas on which to paint Amer- 
ican policy options. Therefore, we are 
making this beginning investment in the 
history of economic reforms in the 
former Soviet Union. 

This cameo of reform efforts ex- 
presses the basic tension in all market- 
oriented economies between economic 
efficiency and socio-economic equity, 
and therefore contributes in its own dis- 
tinct way to our current thinking about 
the conduct of the U.S. economy in a so- 
dai democracy. 



nonproductive individuals and busi- 
nesses, according to Hewett, and unfair 
in distributing rewards for successful 
competition. These correlates of mar- 
ket-driven systems are not supportive 
of egalitarianism. In fact the introduc- 
tion of extensive social and economic 
entitlements, Hewert contends, can seri- 
ously reduce a market economy’s effi- 
ciency and profitability. Therefore the 
form Soviet economic reform has tend- 
ed to take has essentially required a re- 
definition of socialism, 

Hewett views the continuing debate 
over the nature and direction of eco- 
nomic reform in the USSR as a debate 
over efficiency vs, equality principles. 
He says the essence of this debate is 
whether a viable method can be found 
to “dilute the egalitarian bias” of the 
system in achieving more economic ef- 
ficiency — that is, whether a strategy 
can be implemented to accomplish re- 
form goals without destroying .rocm/wr 
legitimacy. 

The Meaning of Economic 
Reform In the USSR 

We tend to forget that Nikita Krush- 
chev proposed economic reforms in 
1957, Aleksei Kosygin in 1965, and 
Leonid Brezhnev in 1973 and 1979, 
However, Hewett does not view these 
as “comprehensive” reforms. They 
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were more in the nature of partial re- 
forms that contributed to later reform 
efforts by alerting leaders to what 
seemed to work well and what did not 
work. Neither does he see Perestroika 
under Gorbachev as a comprehensive 
reform in the economy, if we define 
economic reform as a change in the 
way resource allocation decisions are 
made — i.e. in the “institutional ar- 
rangements” that determine how re- 
sources are produced and distributed. 

The author points out that economic 
reform in the Soviet Uni%/ti and Eastern 
Europe has been associated m.;st often 
with “economic flfecentraliza^ion.” This 
focus is understandable given these 
countries* economic performance prob- 
lems. However, Hewett acknowledges 
that “economic recentralization” can 
also be seen as a reform, whether or not 
it is appropriate in resolving economic 
problems. 

The important issues to study in ana- 
lyzing economic reform el forts, accord- 
ing to the author, are 1) wl letheir the re- 
form t/ecentralizes or recentralizes de- 
cisionmaking regarding resource pro- 
duction ^d allocation, 2) whether the 
reform is comprehensive, and 3) 
whether the refonn affects all major 
economic institutions. Some changes 
are not reforms, he says, such as eco- 
nomic changes that utilize the 
existing system to improve economic 
performance. But such changes are im- 
portant in making significant shifts in 
the way the economy is guided without 
the risk of organized resistance to 
change. 

However, Hewett feels that while 
economic policy changes should be 
part of reform packages, more systemic 
economic reforms must be the major 
drivers of change, particularly given 
the performance problems that faced 
the Soviet Union during the Gorbachev 
period. He would likely take the same 
position today. 

And Hewett cautions that reform 
movements are not all of one piece. 

Each is distinguishable from others 
through its own array of personalities, 
forces and conditions, the particular 
combination of which Influence the 



outcome of reform efforts. Studies of 
these outcomes for the Krushchev and 
Brezlmev eras suggest that the particu- 
lar mix of characteristics these reform 
strategies involved ultimately proved 
fatal, leading to economic retrenchment 
rather than to improved performance. 

Strengths and Weaknesses In 
Soviet Economic Performance 

Hewett’s analysis pinpoints Soviet 
central planning 2 ^ ihe most critical 
source of performance problems. Sovi- 
et leaders attempted to preserve what 
they judged were the strengths in the 
easting system. Including central plan- 
ning, while seeking to reduce or elimi- 
nate the weaknesses, but the two sets of 
attributes were so intertwined as to re- 
duce the effect of this compromise. 

The three main strengths Soviet 
leaders saw in the existing economic 
system were 1) the high level of growth 
in the economy and in living standards, 
2) the high degree of economic security 
in the context of this growth, and 3) the 
system’s commitment to egalitarianism. 
Hewett claims that the USSR came as 
close to full employment as any indus- 
trialized economy can hope to accom- 
plish — “the degree of personal eco- 
nomic security in the workplace [was] 
virtually unparalleled in Western coun- 
tries.” 

Egalitarianism was, of course, a key 
element in Marxism. Marx’s major crit- 
icism of capitalism was that it produced 
and/or reinforced inequities in the dis-- 
tnbution of wealthy income and power. 
He viewed the existence of unemploy- 
ment as a symptom of this inevitability. 
This ideological perspective explained 
socialists’ emphasis on the means of 
production as well as on the allocation 
of resources. The Russian revolution 
was the first effective strategy, Hewett 
says, for acting on this perspective in a 
nation-state, even though the socializa- 
tion ot the means of production was 
completed only after an abusive collec- 
tivization of the peasantry. 

In this kind of system, where the 
state is the only owner of financial as- 
sets and production, Hewett comments 
that one must be gainfully employed to 



earn income. This dependence on wages 
and salaries, rather than on assets, then 
had a leveling effect on income distri- 
bution. The reduction of wages related 
to low unemployment, and the security 
protections afforded workers irrespec- 
tive of the economic profitability of 
their workplaces, also equalized the dis- 
tribution of income. Added to these in- 
come-leveling effects was the high par- 
ticipation of women in the labor force. 
At the same time, economic losses were 
absorbed not by single enterprises but 
spread out across the whole system. 

Even the shortage of goods was an 
equalizing influence. 

The main strengths in the Soviet sys- 
tem — egalitarianism, economic securi- 
ty, and the growth in living standards 
— were generally regarded by Soviet 
leaders as socialist achievements that 
must be preserved. Consequently these 
leaders tended to minimize their poten- 
tial negative effects on economic per- 
formance in proposing economic re- 
forms. Since many of the weaknesses in 
performance were closely tied to a com- 
mitment to economic security and equi- 
ty, reformers had to redefine these con- 
cepts in the process of designing new 
strategies. Hewett feels this helps ex- 
plain the severe difficulties leaders en- 
countered in Soviet reform movements. 

Inefliciencrcs in resource allocation 
were not the primaiy concern in devel- 
oping new approaches. Technical ineffi- 
ciency garnered more attention. That is, 
Soviet reformers felt that the misuse 
and waste of resources in the production 
process were more critical issues to deal 
with than the issue of what sectors of 
the society benefited most or least from 
economic progress. This priority led So- 
viet planners to force enterprises to 
economize on inputs — that is, on labor 
and material — - since these were being 
used at much higher rates than was nec- 
essary within Soviet society, and more 
than was typical in other industrialized 
nations. 

The decline in economic growth 
rales and labor productivity was Gor- 
bachev’s key worry regarding economic 
performance. In a search for causes, So- 
viet experts identified several important 
antecedents I 
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» The low level of mechanization of 
Soviet industrial enterprises. 

■ The tendency to produce low-quality 
goods that did not respond to con- 
sumers^ needs or world standards. 

■ An excess demand for consumer or 
investment goods, 

m A tendency for industrial develop- 
ment to move ahead of infrastruc- 
ture development, creating supply/ 
demand imbalances. 

With the slowing of economic 
growth, Soviet policymakei's had less 
discretion in setting priorities among 
the competing interests and pressures 
from consumers, enterprises and gov- 
ernment agencies seeking sources of in- 
vestment, particularly in the area of de- 
fense spending. Consequently they 
were faced with the need to preserve 
economic equity and security while 
boosting economic growth. This chal- 
lenge underlaid all reform efforts. 

Since it was difficult to determine the 
potential causal linkages between phe- 
nomena such as falling productivity, 
low quality output, imbalances in sup- 
ply/demand, excess demand for invest- 
ment goods, the sustaining of full em- 
ployment, and the maintenance of price 
stability, economic reforms always rep- 
resented agoniang compromises, often 
based on inadequate data and research. 

Earlier Reform Efforts 

Hewett is adamant that Western 
readers place the Gorbachev reform 
package in historical perspective if they 
are to understand its importance. His 
emphasis in analyzing pre-Gorbachev 
reforms is to cast Gorbachev as the first 
soviet leader since Kruschev to con- 
ceive, strongly support and actually im- 
plement economic reforms. 

The 1960s Reforms 

It is tile comprehensive 1965 re- 
forms that provide the best 'context. 

The strategies proposed were similar in 
many ways to Gorbachev’s, and were 
intended to affect fundamental aspects 
of the Soviet economy. In particular 
tliey involved changes in who super- 
vised enterprise activity, in what deter- 



mined the allocation of bonuses to en- 
terprises, and in price control. Among 
other things, these reforms proposed a 
receatralization of planning, moving it 
back from regional authorities to cen- 
tral ministries in Moscow, and a 
strengthening of the discretion of exist- 
ing state committees. 

The most rapidly implemented strat- 
egy was administrative reorganization. 
Implementing the incentive system and 
price reform Tagged considerably be- 
hind. This delay allowed the existing 
system to organize its resistance to 
changes ahead. Many of the reforms 
were never implemented, and the im- 
pact of those put in place was not en- 
during. 

Hewett places the most blame on the 
design of the reforms. It involved too 
many changes at one time, some unre- 
alistic. This created too much pressure 
on the system and led to a dilution of 
strategies before they had been given a 
chance to work. 

The author concludes that the ad- 
ministrative recentralization strategy 
had the most lasting effect. It reinstated 
a Stalinist decisionmaking hierarchy to 
manage the economy, expanding the 
number of central ministries and state 
committees. Succeeding leaders ex- 
panded this apparatus further in an ef- 
fort to control an increasingly complex 
economic system. 

The 1970$ Reforms 

The reforms proposed in 1973 at- 
tempted, Hewett claims, to increase the 
efficiency of this managerial system 
without decentralizing it. This v/as to 
be accomplished by merging various 
enterprises under one decisionmaking 
authority, permitting this authority to 
shift production tasks and input allot- 
ments from the least to most efficient 
enterprises. Brezhnev wanted the cen- 
tral authority to move away from the 
operational management of enterprise 
activity into long-range strategic plan- 
ning for entire economic sectors. 

However, the 1975 reforms, which 
were to merge enterprises into more 
controllable units, did not result in the 
changes planned. Ministers managed to 



protect llieir empires and enterprises 
from sharing decisionmaking with oth- 
er businesses. If the^e were efficiency 
gains, Hewett’s view is that they were 
swallowed up by burdensome adminis- 
tration. 

The author draws three key lessons 
from the failure of tliese reforms: 

1. Do not ask the very entities you 
hope to reform to be responsible for 
the reduction of their own powers. 

2. Do not neglect the demand-side con- 
sequences of reform, while focusing 
on supply-side solutions — tlie 
mergers actually increased the high 
concentration of Soviet industry and 
the power of suppliers, which can- 
celled out the reform’s potential in- 
centive effects. 

3. Do not allow a central government 
body to control merger activity, 
since this activity then may not be 
driven by a search for increased 
profits. 

In 1979, there was another effort to 
redirect the economy. The most inno- 
vative component, Hewett believes, 
was to develop performance indicators. 
At the risk of oversimplification, under 
this system an enterprise using more la- 
bor than a certain determined amount 
would not be rewarded, whereas more 
productive and efficient ones would be. 
There were problems with the use of 
aggregate measures of enterprise activi- 
ty, however, and no serious effort was 
made to implement this reform. 

Reform Accomplishments 

Taken as a whole cloth, there were 
two common elements in this series of 
generally unsuccessful post-Stalin re- 
forms: 

■ The basic tool of reform was the 
central economic plan. This plan 
was developed by central govern- 
ment ministries and involved indica- 
tors to determine enterprises’ com- 
pliance with the plan, as well as the 
allocation of bonuses to enterprises 
that met or exceeded the plan’s ex- 
pectations. 
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The reforms did not focus on the 
needs and demands of customers in 
the open market, but rather on cen- 
tral decisions about what constituted 
high quality goods. There was a fear 
of loss of control if world markets 
were allowed to direct Soviet enter- 
prises. 



As a result of Soviet resistance to 
giving ‘‘the market” the primary role in 
, increasing economic efficiency, the 
pre-Gorbachev reforms experimented 
mainly with plan indicators and incen- 
tive systems, leaving the organizational 
mechanisms operating the existing 
economy largely intact. 



Hewett makes these comments at the 
end of his analysis of the pre-Gor- 
bachev reforms: 



In their totality, economic reforms 
imply a theory , , . concerning the na- 
ture of the problems^ the systemic 
changes needed to fix the problems, 
and the best strategy for bringing 
about those changes. In the history of 
Soviet reform efforts, most of the 
leadership’s attention has been fo- 
cused on the first two components of 
the theoky: what’s wrong, and what’s 
the fix? The strategic issue has not 
been addressed openly, and ... the 
approach has been rather simple- 
minded: the bureaucracy will, in 
good faith, design and implement de- 
crees conforming to the wishes of the 
party. However, the modest results of 
previous reform efforts have gradual- 
ly stirred up interest in the strategic 
issue, with the result tliat a rather 
simple, widely held theory has 
emerged that previous reforms failed 
primarily because of bureaucratic re- 
sistance centered in the ministries . , . 
this view is not wrong, but it is in- 
complete and superficial...it fails to 
take into account the flaws in reform 
design that create incentives for min- 
istries to preserve controls over en- 
terprises. Furthermore, it assumes 
that other elements of the system are 
anxious for the reforms to work , . . 
this ignores the large and important 
political issues that affect in a funda- 
mental way the choices made in the 
design of reforms and the fate of the 
resulting decrees. 



Hewstt emphasizes that reform in- 
volves a complicated process requiring 
the involvement and investment of all 
relevant stakeholders. This participa- 
tion cannot occur without neutralizing 
the effect of the proposed changes on 
those losing something, and without 
enlisting the support of those having 
something to gain. But the Soviet re- 
forms continued to permit a more au- 
thoritarian process. 



Relevant to the design of reforms, 
he advocated a first step dedicated to 
the development of very clear priorities 
and emphases, followed by strategics 
capable of anticipating and reducing 
the inevitable conflict created by gains 
and losses in the major groups affected 
by change. 



The Economic Reform Debate 
In the 1980e 



Hewett classifies the Soviet players 
in the ongoing 1980s debates about 
economic reform into three general cat- 
egories: 



The neocofiservatives y who support- 
ed a return to the basic principles of 
Stalinist centnil planning, but with- 
out its correlate of political repres- 



sion. 



The moderates, who accepted the 
existing system but had significant 
ideas for improving it. 



■ The radical reformers, who advocat- 
ed system-wide reforms, particularly 
a decentialization of the manage- 
ment of the economic system. 



The core of the neoconservative po- 
sition was that the economic system 
must become better disciplined — but 
proponents differed considerably about 
the means for accomplishing this. The 
main question was whether markets 
should be used as the tool for imposing 
such discipline. 



Most Soviet economists fell iirto the 
moderate group, which represented a 
wide range of views about how to re- 
structure the economy, stretching be- 
tween a commitment to strong central 
planning at one end of the continuum, 
to radical comprehensive reform at the 
other. Most wanted to sec substantial 
improvement in the quality and effi- 



ciency of central planning, but in gen- 
eral supported the ministerial system 
even though opposing its authoritarian 
control over enterprise activity. The 
idea of mergers appealed to most of 
these economists, where planning could 
be consolidated for a small number of 
major economic sectors. 

In the midst of these considerations, 
Mikhail Gorbachev opened Pandora’s 
Box, taking the position in his speech 
at the 1985 Party Congress that the eco- 
nomic situation was such that it was no 
longer possible to make partial im- 
provements — what was needed, he 
said, was “radical reform.” The subse- 
quent development of radical reform 
positions took two forms: 1) compre- 
hensive reforms similar to the Hungari- 
an model, and 2) reforms that sought a 
better economic compromise between 
economic performance goals and the 
vast safety net protections for individu- 
als and families. The latter position 
brought to the surface the underlying 
and ongoing tension between economic 
efficiency and socio-economic equity. 

Although Hungary was viewed with 
interest, insights fi-om the reforms initi- 
ated in other socialist countries had re- 
markably little influence on the nature 
of Soviet reform ideas. This was the 
case even though Gorbachev encour- 
aged a formal study of reforms in East- 
ern Europe, particularly Poland, Hun- 
gary and East Germany. The latter 
models could have been very useful, 
but serious consideration of them flew 
in the face of historical Soviet beliefs 
that the problems of the USSR were 
unique and could be understood best in 
isolation from the broader tapestry of 
20th century socialist reforms. 



The Gorbachev Reforms 



The five-year plan emerging under 
Gorbachev for 1986-1990 had very am- 
b.tious goals. It proposed a reversal of 
the downward trend in economic 
^owth rates in all major output catego- 
ries. Hewett reports that national in- 
come was to grow at an average of 
4.1%, and labor productivity at 4.6%, 
comparable to the early 1970s. Real per 
capita income growth rates were to av- 
erage 2.7%, significantly above recent 
rates, even if considerably below the 
early 1970s. In the 1990s these rates 
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vere to be increased even more dramat- 
ically. 

The means for meeting these targets, 
over 8 two-phase process, was to be a 
massive improvement in the quality of 
goods and services produced. Gor- 
bachev presented the five-year plan as a 
route to settiiig world quality standards, 
not simply a way to meet the plan’s 
goals. This was uiireaiistic, more a po« 
litical ploy than a rational economic 
position. Hewett’s opinion is that the 
real test of Gorbachev’s reform plan 
lay in whether he would support suffi- 
cient economic discipline to achieve the 
high-quality output proposed. 

The first stage of reform was to fo- 
cus on partial changes. The second was 
to involve the more comprehensive 
changes. In 1987 the major outlines of 
the second stage were fleshed out by 
the Aganbcgian Scientific Council 
working with a system of committees 
assigned to design different compo- 
nents of the reform. This activity pro- 
duced much open debate and better 
consensus-building, and a set of guid- 
ing principles were established that 
would direct economic reform based on 
the Council’s work. 

Hewett describes these principles as 
a set of interrelated changes in all of 
the key mechanisms operating in the 
economic system — a comprehensive 
and mdical reform package: 

■ Annual central plans were to be 
eliminated. 

■ Private sector economic activity and 
the development of economic coop- 
eratives were to be encouraged in 
certain sectors. 

■ Enterprises were to be allowed to go 
bankrupt. 

m Workers were to be allowed to lose 
their Jobs. 

■ Prices were to be far more flexible. 

■ The monetaiy system was to re- 
spond to a truer medium of ex- 
change. 

This agenda was to make substantial 
changes in the decisionmaking hierar- 
chy, the information system for policy- 
mal^g, and the incentive system re- 
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warding or sanctioning enterprises for 
tlieir performance. Interestingly, East- 
ern Euiopean and Chinese economic 
reforms emerged in some of these prin- 
ciples, even though uncredited. 

Direct, detailed central management 
of enterprises through an annual plan 
was to be jettisoned, leaving enterprises 
responsible for the economical use of 
their assets, and for either the rewards 
or costs related to the general perfor- 
mance goals set for their own economic 
sector by the central government minis- 
tries. These enterprises were also to be 
freed, Hewett says, from local manage- 
ment interference. In essence they were 
to be left vulnerable to competition in 
the marketplace. Within this frame- 
work, state enterprises were to be 
placed in competition with new private 
sector self-employment schemes and 
small cooperatives. For the Soviet labor 
force, the Gorbachev reforms, accord- 
ing to Hewett, amounted to “threaten- 
ing the workers of poorly managed en- 
terprises with lower income, and even 
the loss of their jobs, but at the same 
time , , . giving them a role in choosing 
and controlling enterprise manage- 
ment.” 

The deadline for implementing this 
second and most all-encompassing 
phase of economic reform was January 
1991 , in retrospect a deadline beyond 
Gorbachev’s tenure as Soviet leader. 

The Implementation of the 
Gorbachev Reforms 

Hewett thought implementation 
would be very difficult, with “powerful 
and frequent temptations to retreat from 
the principles of the reform.” The most 
important political question, he sug- 
gests, was how to reduce the negative 
effects of the transition to a new eco- 
nomic system and therefore create and 
maintain the new system’s legitimacy 
with important stakeholders and the 
Soviet people. Serious economic ques- 
tions attached to the pace and chronolo- 
gy of reform, and the fairness with 
which the transition was carried out. 

Hewett is convinced that Gorbachev 
was more interested than any other So- 
viet leader in the USSR’s position in 
the worW economy. He believed the 
Soviet Union would not be successful 
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economically if it could not compete in 
world markets. But he was equally con- 
cerned, according to Hewett, about na- 
tional security and the level of domes- 
tic support for the Communist Party. 
Hewett’s fear was that if the Gorbachev 
reforms lost momentum, the USSR 
might rely primarily on military power 
in the context of residual strength in 
that sector but weakness economically 
and politically. 

Concemed about the outcomes of 
the Gorbachev reforms, Hewett propos- 
es four possible scenarios for the fu- 
ture: 

1 . The success scenario: everything 
works as planned. The reforms oc- 
cur rapidly, output quality improves 
substantially, and so does economic 
efficiency. 

2. The high groyvth scenario: the na- 
tional income growth rates are close 
to what was planned, with only 
moderate improvement in the quali- 
ty of goods and services. 

3. The high quality scenario: econom- 
ic growth performance is moderate 
but quality indicators express signif- 
icant and sustained improvement, 
even though economic efficiency is 
not substantial. 

4. The failure scenario: nothing 
works. 

Hewett sees some scenarios as more 
probable than others. The extremes 
were less likely to occur. However, 
“success” would, he thinks, require that 
almost everything ‘go right’ — the de- 
sign of the reform perfect, the imple- 
mentation strategy flawless, and radical 
improvement in quality resulting. Re- 
ferring to the history of previous re- 
form efforts, he says neither the work- 
force nor industrial management was 
likely to respond at a level that would 
allow this to happen. 

implications of Success or 
Failure for the West 

It is intriguing, given the coup at- 
tempt against Gorbachev, the subse- 
quent end of his leadership, and the dis- 
solution of the Soviet Union, that 
Hewett predicts that the “failure” see- 
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nario woidd be very unlikely, since it 
would require some “dramatic turn- 
around” such as the removal of Gor- 
bachev and a shift of power to econom- 
ic hardliners. Without benefit of a 
crystal ball, Hewett suspects chat the 
tw'o middle-r^nge scenarios would do 
most to enhance Soviet economic rela- 
tions with the West. However, he is 
less certain about the benefits for Sovi- 
et foreign and defense policy. His gen- 
eral assessment is that successful eco- 
nomic reform would give Soviet 
leaders the capability either to follow a 
less aggressive foreign policy or to fi- 
nance a greater military build-up. The 
choice, he thinks, would rest with the 
level of success in reforming the Soviet 
political system. 

Hewett expects that successful re- 
forms could lead to a country better 
able to pursue traditional foreign policy 
and defense goals, become a new cus- 
tomer for Western goods, and a new 
competitor in world markets. It could 
also mean a gradual democratization of 
the political system, consistent with the 
long-term interests of Western nations. 
Success could lead, he believes, to 
greater participation by the Soviet 
Union in international economic insti- 
tutions and markets, and to new rela- 
tionships with the West based more on 
economic than defense issues. A reform 
scenario that stimulated technological 
innovation and improved the quality of 
Soviet goods and servi':es would, he 
concludes, enhance Soviet economic 
ties with the West. Unsuccessful reform 
scenarios could reverse these trends. 

Hewett does not think Western in- 
fluence over the outcome of the Gor- 
bachev reforms would be more than 
minimal. The West would be capable 
only of exerting pressure for minor cor- 
rections in the reform process, perhaps 
making that process more likely to oc- 
cur. This forecast appeared to be accu- 
rate for the early Yeltsin period, but is 
now debatable as neoconservative 
views have gained momentum with the 
growing divisions in political leadership. 



■ ■ 

Gorbachev’s 

Perestroika 

As president of the former Soviet 
Union, Mikhail Sergeyevich Gor- 
bachev became deeply involved in eco- 
nomic issues, particularly reforms that 
could lead to greater economic perfor- 
mance. The Twelfth Five-Year Plan, 
for 1986 through 1990, gave substan- 
tial expression to his goals for reform: 
higher national income growth rates, 
the acceleration of economic develop- 
ment, the improvement of production 
and its products, and changes in the 
public's view of the economy and soci- 
ety. The reform concept and plan for 
change was described in his book Pere- 
stroika: New Thinking for Our Country 
and the World published in 1987, 
which significantly influenced econom- 
ic thinking not only in the former 
USSR but in Central and Eastern Eu- 
rope. 

Mr. Gorbachev no longer exerts di- 
rect political, economic or ideological 
influence in the new republics formed 
by the break-up of the USSR, but he is 
anything but a has-been. Following his 
fall from power in 1991 , he formed the 
International Foundation for Socio- 
Economic and Political Studies in 
Moscow, and subsequently an arm of 
this foundation in tlie United States, 

The Gorbachev Foundation USA in 
San Francisco, The foundation serves 
as an economic and political ‘think 
tank* intended to promote social de- 
mocracy in the former Soviet republics, 
and sponsors international seminars 
and conferences on global economic, 
political, environmental and peace is- 
sues, including defense conversion. 

Only sixteen months after serving as 
president of the Soviet Union and gen- 
eral secretary of its Communist Party, 
he was named president of the Interna- 
tional Green Cross and Green Cres- 
cent, which aspire to represent for envi- 
ronmental crises what the Red Cross 
and the Red Crescent already represent 
for disaster relief. According to Micha- 
el Wines of The New York Times^ Mr. 
Gorbachev’s idealistic plan aims to 
“standardize antipollution laws world- 
wide* integrate the diverse efforts of 



environmental groups, and press rich 
countries and corporations to assume 
their share of the global clean-up task.” 

Although Gorbachev hardly seems 
to qualify as an environmental czar, 
given some of the history of his tenure 
as president of the Soviet Union, the 
concept of an International Green Cross 
was, in fact, Mr. Gorbachev’s idea — 
although the organization is supported 
by an international group of prominent 
political, scientific and spiritual lead- 
ers. And his affinity for ecological pro- 
tection is not as inconsistent as it might 
seem to the West. 

Rejoined the Communist Party in 
1952, quickly becoming a leader of the 
Stavropol Komsomol. In 1955 he grad- 
uated from the Law Department of 
Moscow State University as part of an 
elite group of Russian lawyers. Be- 
tween 1985 and 1990 he followed a 
straight-line political trajectory leading 
to the status of First Secretary of the 
Stavropol Territory Committee of the 
Communist Party’s Central Committee, 
then Chairman of the USSR Council of 
Defense and a member of the Presidi- 
um of the USSR Supreme Soviet, and 
ultimately to the president of the Soviet 
Union. 

Bom on a farm in Southern Russia 
and steeped in rural agricultural life 
growing up, he had long been con- 
cerned about deteriorating fisheries and 
fore.sts, and about the management of 
farming, and had served as the USSR’s 
top agricultural official prior to becom- 
ing president. Therefore the interview 
Mr. Gorbachev provided to Colin Greer 
for Parade Magazine in January of 
1994 is informative regarding his view 
of his new role vis-a-vis international 
environmental activism: 

We need to spawn a different intel- 
lectual and values climate and a dif- 
ferent set of economic goals. No 
country actually believes the free 
market can be socially irresponsible. 

I want more socially oriented market 
economies in the world. ... At the 
same time, the business marketplace 
that is based on economic freedom, 
that can function with independent 
producers and owners, forms the ma- 
terial basis for democracies. I sec no 




86 



96 



EvtlutUon Form • I««ua11 > Summon 90S 






Evaluation issues and Activities > Economic Reform In the Former Soviet Union 



The course of intensification is dictated by objective conditions, by 
the entire course of development of the country. There are no 
alternatives. Only an intensive economy, developing on the basis 
of a state-of-the-art scientific-technical base, can serve as a 
reliable material base for Increasing the welfare of workers, 
guaranteeing the strengthening of the position of the country on 
the International arena, ensuring that it will deservingly enter the 
new century as a great and prospering power. 

Mikhail S. Gorbachev, in Pravda, December 1984. 



contradiction between the market and 
democracy. If we are going to protect 
the planet’s ecology, wc are going to 
need to find alternatives to the con- 
sumerist dream that is attracting the 
world. Otherwise, how will we con- 
serve our resources, and how wall 
we avoid setting people against each 
other when resources are depleted? 

Given this revised view of the politi- 
cal architect of Perestroika, what were 
the majorr< orms proposed within this 
second Russian revolution in the 
1900s? 

The Concept of Perestroika 

The most immediate priority at that 
time, according to Gorbachev’s book, 
was to put the economy in order, tight- 
en discipline, and raise the level of or- 
ganization and responsibility. A pro- 
found structural reorganization of the 
economy was needed, he felt — a re- 
construction of its material base, the 
development of new technologies, 
changes in investment policy, higher 
management standards. 

The government, he proposed, need- 
ed to shift economic activity from new 
construction to the technical retooling 
of enterprises, to saving resources, to 
sharply raising the quality of output. At 
the same time it needed to change the 
moral and psychological situation in 
society, and the organization, style and 
methods of work. A policy cf openness 
and social justice was needed. 

It was imperative, he contended, that 
government take into consideration the 
diverse interests of people, of work col- 
lectives, of public bodies, and of vari- 
ous social groups, drawing them into 



active, constructive collaboration to 
improve the economic situation. Pere- 
stroika was not only about reforming 
the economy but about opening up and 
democratizing Soviet society, and en- 
gaging people more directly in its im- 
provement. 

In June, 1987, the CPSU Central 
Committee adopted principles for im- 
plementing this approach to reform in 
“Fundamentals of Radical Restructur- 
ing of Economic Management.” This 
was likely the most radical program for 
economic reform in the Soviet Union 
since Lenin introduced his New Eco- 
nomic Policy in 1921. It proposed a 
transition from an excessively central- 
ized management system to one based 
on democratic centralism and self- 
management So Perestroika had sev- 
eral dimensions: 

■ The overcoming of economic stag- 
nation and an acceleration of social 
and economic progress and dyna- 
mism. 

■ The comprehensive development of 
democracy and an encouragement of 
individual initiative, creativity and 
discipline. 

• A shift to scientific methods, and a 
better linkage between the achieve- 
ments of the scientific and techno- 
logical revolution and a planned 
economy, 

■ Better living and working conditions 
for Soviet citizens. 

■ Greater social justice. 

■ An elevation of honest, highly-qual- 
ified labor. 



In this sense. Perestroika involved a 
renewal of every aspect of Soviet life. 

implementation Challenges 

Gorbachev’s thinking, the work of 
the designers of his reforms, his ac- 
claimed book, and the institutionaliza- 
tion of new ideas in significant policy 
pronouncements, launched enormous 
changes in the USSR which have con- 
tinued to influence developments in 
Russia and the other republics. This is 
not to deny that there were serious 
challenges to economic reform during 
this early reform period as well as cur- 
rently. 

One challenge has been the need to 
modernize the economy and shift in- 
vestment policies. Another has been the 
necessity of freeing central authorities 
from an operational role, to a more 
general focus on improving the eco- 
nomic environment and directing the 
basic steps in economic development. 
The new economic system was expect- 
ed to emphasize more decisionmaking 
authority and much greater responsi- 
bility and accountability at the regional 
and local level The expanded role for 
private and cooperative economic ac- 
tivity also posed challenges. 

Certainly the shift from obligatory 
State economic targets to norms linked 
to the performance of enterprises has 
been a genuine challenge. The reorga- 
nization of different levels of the gov- 
ernment hierarchy, and the emphasis on 
the coordination of activity have con- 
stituted new hurdles. Establishing a 
new incentive system affecting both en- 
terprises and workers, as well as the 
branches of government monitoring 
them, has also tested the reform move- 
ment. An additional and very important 
challenge has been deciding whether 
some reforms should be implemented 
before others, and sorting out how to 
deal with the effects of the transition. 

Comment 

For Central and Eastern Europe, and 
for the former Soviet Union, the transi- 
tion to a market economy clearly repre- 
sents a difficult historical passage. This 
is certainly to be expected given the 
magnitude of the economic, social and 
cultural changes occurring in these so- 
cieties in the context of their traditions. 
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For readers interested in more infor- 
mation about Mr, Gorbachev’s ideas, 
please see: 



Peace Has No Alternatives. A collection 
of speeches, articles and interviews. 
South Asia Books, 1986. 

Perestroika: New Thinking for Our 
Country and the World. New York, 
NY: Harper Collins, 1987. 

A Road to the Future. The text of Mr. 
Gorbachev's address to the United 
Nations. Ocean Tree Books, 1990. 

The August Coup: the Truth and the 
Lessons. New York, NY: Harper Col- 
lins, 1992. 
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The USSR in the 
Transition Period 

In this article we again take a look at 
the pre-Yeltsin period in the Soviet 
Union. The perspective this time is 
based on Alexander Samorodov’s 
chapter in a book published in 1 993 by 
the Organization for Economic Cooper- 
ation and Development, Structural 
Change in Central and Eastern Europe 
edited by George Fischer and Guy 
Standing. The author gives us a more 
detailed appreciation of economic and 
labor force issues in the Soviet Union 
prior to the creation of the independent 
republics. 

Launching the Reforms 

Samorodov introduced his chapter 
on “The Labour Market, Social Policy 
and Industrial Relations in the USSR 
Under Transition*’ with some bleak sta- 
tistics. The USSR’s GNP was estimated 
to have declined 17.9% in 1991 and 
production by 15%. Trade with other 
countries had fallen over 39% in 1991. 
The official inflation figure was 10% 
for 1990, but may actually have been as 
high as 25%. The rouble had been de- 
valued six times since December 1990, 
a decline of over 80% in its value. 

This was a very difficult way to be- 
gin a transition to a market economy, 
Samorodov muses. Nevertheless, in 
April 1991 the Soviet Cabinet of Min- 
isters indeed proposed to launch such a 
reform. A number of goals were to be 
accomplished within the reform, such 
as these: 

■ To resuscitate economic ties be- 
tween the USSR and COMECON, 
the trading network involving Cen- 
tral and Eastern Europe. 

a To increase internal economic link- 
ages between enterprises. 

■ To provide “most favored nation” 
status in international trade to those 
republics willing to sign the union 
treaty. 

■ To begin privatization, particularly 
regarding small businesses. 

■ To ban strikes temporarily to stabi- 
lize the labor market. 



B To hire business managers and ex- 
perts to increase efficiency. 

■ To provide fiscal incentives to work- 
ers to increase productivity, such as 
removing the limits on personal in- 
come and increasing the amount of in- 
come exempt from taxation. 

A Framework for Reform 

A wide range of new laws were 
passed in 1990 and 1991 to implement 
reform goals. However, Samorodov^s 
conclusion is tliat despite this legisla- 
tive activity no adequate legal frame- 
work for a market economy had been 
put in place by late 1991. The reasons 
were many. Samorodov suggests the 
follov/ing: 

« Population growth rates were declin- 
ing except in the Central Asian re- 
publics. 

■ Urbanization was continuing — 
two-thirds of the population were 
urban residents in 1990 compared 
to 48% in 1957. 

■ Total employment was declining but 
new employment forms were emerg- 
ing, such as cooperatives, self-em- 
ployment, and joint stock companies. 

B Although mass layoffs had not oc- 
curred, part-time, less than year- 
round, and seasonal employment 
was growing. 

a Labor supply and demand were seri- 
ously mismatched — in 1991 nearly 
97% of laid-off workers were gov- 
ernment employees, but 85% of the 
Job openings were for blue collar 
workers. 

n The lack of geographical mobility, 
housing and employment services, 
and complicating administrative reg- 
ulations, were hampering the reem- 
ployment of the unemployed. This 
was in the context of a society inex- 
perienced in dealing with unemploy- 
ment, where the tendency was to 
view the unemployed as personal 
failures. 

a Two-thirds of young people (teenag- 
ers and those in their 20’s) lacked 
vocational training. 
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Consequences for Workers 

Samodorov reports that a high and 
continuing level oi displacement and 
dislocation were occurring during this 
early period of reform. He explains this 
phenomenon in terms of increased eco- 
nomic accountability pressures, the mi- 
gration of labor &om the public to the 
private sector, and the greater discre- 
tion on the part of businesses in hiring 
and firing workers. He says some ex- 
perts predicted a loss of 40 million jobs 
from the public sector for 1995, a num- 
ber likely to be increased by the num^ 
ber of workers let go from enterprises 
suffering economic losses. Also, the _ 
elimination of villages considered 
productive was seriously affecting rural 
employment. 

Ethnic unrest and a substantial 
movement of workers to Central and 
Eastern Europe and elsewhere could, 
Samodorov proposes, significantly in- 
crease transition problems, such as the 
reduction of the supply of highly quali- 
fied young workers. The most difiicult 
situation concerned youth employment 
in Central Asia, where in the 1980s half 
of all unemployed workers were yoiuig 
people. The main issue was dissonance 
between their skills and available jobs, 
and their vulnerability to layoffs in the 
midst of restructuring. Long-term youth 
unemployment was becoming a majo) 
problem. 

More generally, Samodorov points 
out that a key consequence of rsstnic- 
turing in the direction of a iriarket 
economy was the absorption of the 
public sector and industrial unem- 
ployed by the service sector, reducing 
blue collar workers’ wages and sala- 
ries. Service income fell from 80% of 
non-service sector income to 70-75% 
between 1975 and 1990. 

Remedial Strategies 

In the context of these develop- 
ments, the author emphasized the im- 
portance of the 1991 USSR Law on 
Employment of Population in address- 
ing major labor force problems. Al- 
though the USSR separated into repub- 
lics eleven months later, this law 
affected subsequent employment poli- 
cies in Russia and the other republics 
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— it became the foundation for subse- 
quent market-oriented kws. The i99l 
law and related legislation reinforced 
tlte traditional right to work, and ended 
what Samorodprv Ic'^eled “the system of 
administrative CrOercion to work.” The 
“centra.1 government was.snsuring tliat 
individuals would have uie freedcri to 
choose then form of employment 
in the limits set by the mgritet. Thii 
“rifht to work*' guarantee included the 
right to pursue unpaid work, sucii as 
acquiring addition?! education, to con- 
tribute work for the public good, and to 
raise children — all of these were to be 
considered produciive and creative 
work 

The law also established formal def- 
initions foT “employed,” “unem- 
ployed,” and “suitable jobs.” In addi- 
tion it pk;C>?d emphasis on employment 
services, which had been inadequate 
and little used in the past. These ex- 
panded service:* were to include screen- 
ing for the unemployed, paying unem- 
ployment benefits, organizing public 
works projects that could absorb the 
unemployed, and referring workers to 
sources cf training and retraining. The 
qualification and training of employ- 
ment service staffs were to be greatly 
improved and the number of offices in- 
creased. 

The 1991 law also supported tlic oe- 
velopment and implementation of spe- 
cial programs at the central, regional 
and local levels to create jobs, prevent 
unemployment, assist workers in be- 
coming reemployed, protect workers 
from the negative consequences of eco- 
nomic change,, and increase workers ' 
mobility through retraining and reloca- 
tion. Workers kid off from business or 
industry were to receive severance pay 
up to three months, equal to their aver- 
age wages for tliat peried. Those work- 
ers laid off due to Ae reduction of 
staffs or to business failure or reorgani- 
zation, and who were to be retrained 
for a new job, were to receive grants 
equal to a portion of their previous av- 
erage wage while in retraining. 

Unemployed workers meeting estab- 
lished eligiblity requirements were to 
be paid unemployment benefits until 
they found another job or up to twenty- 



six weeks V a.^id there wen? special ex- 
tended benefits available for the long- 
term unemployed, unemployed military 
persoii’mei, and other categories of 
workers such 'fiev/ emrants to the la- 
bor force. The law also requh'cd that 
strengthened retraining programs were 
to be an inlsgraS part of labor market 
policy. Disadvantaged groups — youth, 
women v/ith young children, the aged, 
the disabled, and the ur>skilled — were 
given special priority, as were geo- 
graphical regions with tl^e more promi- 
nent labor surplu^s or deficits. 

Afl of thes^ laws we.e intended, 
SamorodoY says, to speed the transition 
io a market economy, provide a legal 
j&amework for refoiTn, and reduce the 
negative consequences of change. After 
the break-up of the Soviet Union, how- 
ever, the individual republics began to 
adopt their owm legislation. Each re- 
public charted its own course — but 
with elements in common with others: 
privatization, price liberalization, and 
the lifting of limits on personal income. 

Family Incomes 

Service occupations were viewed as 
the major sources of employment for 
the unemployed and disach^«mtaged de- 
spite the fact that wages and salaries in 
this sector had fallen. This position was 
maintained even though approximately 
a quarter o f the population of the re- 
publics already had incomes close to 
the minimum wage level. 

Social support for the poor and other 
vulnerable worker populations became 
imperative, given the need to reduce 
unemployment without restricting labor 
flexibility. This new mandate was exac- 
erbated by inflation which had grown 
500% prior to price liberalization in 
1992. Even, with the freeing of prices, 
Samodorov says, the government found 
it could only protect the very poor. 
Family and child allowances were in- 
creased based on family income, but a 
debate persisted over what the guaran- 
teed minimum income should be. 

However, the deregulation of wages, 
part of the move toward a market econ- 
omy, had widespread effects of another 
kind. The average monthly wages in 
the USSR were allowed to rise continu- 
ally during the Perestroika years, lead- 
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The Market Meets its Match (Harvard University Press), by 
A.Iice Amsden of Jacek Kochanowicz of the University of 
Warsaw, and Lance Taylor of the New School for Social 
Research, offers a critique* of “shock therapy" as practiced in 
Eastern Europe, envisioning instead a gradual transition to free 
markets based on East Asia’s experience. . . . But Jeffrey 
Sachs, an economist at Harvard and an intellectual architect of 

shock the, apy, brushes aside the authors’ alternative Mr. 

Sachs contends that the successes writ so large on Asia’s 
nearly blank economic slate can hardly be models for 
economies with legacies of bureaucratic meddling and a fierce 

sense of populist entitlement Mr. Sachs argues that the 

oomparisons (with Japan, South Korea and China] are 
spurious. The Asian miracle economies started the process of 
development as rural societies with little capital, no government 
safety net and very low expectations. Eastern Europe, by 
contrast, is largely urban and heavily — Indeed, excessively — 
industrialized — Eastern Europe is stuck v«/ith the crumbling 
remnants of a Stalinist industrial Infrastructure, wary multina- 
tionals that insist on controlling their own technology, and 
workers who are linked to enterprises the way medieval 
peasants were tied to manors. ... As for gradualism, Mr. Sachs 
points out that China dropped the commune system overnight. 

. . . And while China has never disciplined its state-owned 
Industrial sector by opening markets or eliminating subsidies, it 
has built a modern economy around the relatively small 
decaying core — something Eastern Europe cannot afford to 

do because the decaying core isn’t smal: Shock therapy 

still seems superior to the alternatives." 

Peter Passell, in the January 19, 1995 New York Times 



ing to larger social expenditures, a 
greater budget deficit, and rising infla- 
tion. Therefore wages were growing in 
spite of the decline in production and 
labor productivity. And higher wages 
were, to large extent, demolished by 
higher inflation. Pressures from work- 
ers to right this wrong began to surge. 

Meanwhile, growing income in- 
equality was occurring due to the polar- 
ization between tliose with fixed in- 
comes (grants, stipends and pensions) 
and tliose with deregulated wages and 
salaries. New trade unions of million- 
aires emerged, while pensioners’ stan- 
dard of living plummeted. A new poli- 
cy for negotiating wages and salaries 
evolved to address this new socio-eco- 
nomic stratification. It involved “a sys- 
tem of tripartite collective labour agree- 
ments,” according to Samodorov — 
the government, employer associations, 



and trade unions. The market, however, 
was to determine wage and salary levels 
through "‘"‘collective contracts between 
management and labour.” These were 
bargaining agreements, quite different in 
concept from contracts under the previ- 
ous centrally-planned economy. 

Skill Levels and Retraining 

Samodorov reminds the reader that 
the USSR’s workforce was, in gerieral, 
quite skilled. For example he reports 
that in 1991 there were 35 million spe- 
cialists (skilled workers and profession- 
als) and 82 million skilled blue collar 
workers. Graduates from new vocation- 
al training schools had increased annu- 
ally. Over 33 million workers and 10.5 
million managers and specialists were 
being trained on an ongoing basis that 
year. So the new training challenges 
were more related to rising unemploy- 



ment than to the skill level of the work- 
force, particularly to structural unem- 
ployment. However, with the changed 
employment situation of the 1990s, re- 
placing labor shortages through labor 
surpluses and increasing retraining and 
related support programs became criti- 
cal. Many workers had a narrow range 
of skills which frequently failed to fit 
the emerging occupational structure. 

The author feels that “the scale of 
retraining” at this time was inadequate. 
The average Soviet worker was less 
well trained than his counterpart in Eu- 
rope. Most workers were used to stay- 
ing with a given enterprise Aeir entire 
working lives. With the move to a mar- 
ket system, businesses questioned the 
wisdom of retraining, given the uncer- 
tainty of long-term worker tenure. So 
in 1991, tlie USSR initiated a reorgani- 
zation of their retraining system, estab- 
lishing jbrwfs/ training/retraining cen- 
ters. 

Privatization 

Samodorov views privatization as a 
major component of USSR reform ef- 
forts under Gorbachev. The main strat- 
egy implemented during that period 
was the establishment of joint stock 
companies in place of public enteipris- 
es. These often involved shareholding 
by employees. By the end of 1990, over 
two thousand industrial enterprises, ap- 
proximately two hundred large con- 
struction firms, thirty-three thousand 
small businesses, and eight hundred 
municipal and public transportation en- 
terprises were placed under a lease sys- 
tem. Based on a survey of enterprises, 
those defined as unprofitable were rap- 
idly privatized. In tlie agricultural sec- 
tor, private farming began in earnest in 
1989, replacing a portion of the collec- 
tive and state farms, and by 1990 there 
were approximately one hundred thou- 
sand private fanners. 

A new Union of Lessees and Em- 
ployers covered more than ten million 
people. The Scientific Industrial Union 
incorporated many of the largest enter- 
prises and associations. This Union 
represented two-thirds of the USSR’s 
industrial output. Even so, Samorodov 
reports that only about ten percent of 
the total labor force was employed by 
private sector companies* 
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Unions continued to grow in power, 
even though they were part of new 
three-way partnerships. Their new sta- 
tus under Perestroika gave them inde- 
pendence from political and state insti- 
tutions, Samodorov explains, and the 
opportunity to provide legal and social 
protection to workers in the private sec- 
tor. Laws regarding unions assured 
equal rights for all unions, whether in 
the public or private sector, and permit- 
ted them to participate in negotiations 
over a range of issues, including their 
interest in wage indexation. 

But the author comments that few 
managers of enterprises in the newly 
privatized businesses had training or 
experience in how to operate private 
sector market-oriented companies. As a 
result, management training was accel- 
erated, often utilizing experts outside 
the republics. 

Some Conclusions 

While the independent republics that 
followed the dissolution of the Soviet 
Union continued to favor the transition 
to a market economy, their economic 
health remained problematic. Unem- 
ployment continued to rise. Retraining 
centers were slow to function. The 
most significant challenge for govern- 
ments was the development of efficient, 
effective labor market policies that 
could reduce the negative social conse- 
quences of the market reforms. 
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■ Economic Reform in the Former Soviet Union 




The articles In this international sec- 
tion of the journal have focused on a 
range of economic and employment is- 
sues facing all industrialized nations in 
the 1990s. Major efforts to reform and 
restructure economic activity In the con- 
text of unprecedented International 
competition are having a significant im- 
pact on cycllcat and structural employ- 
ment in these countries. 

Some of these nations are in a 
postinJustrial phase of development. 
Others are In transition from collectivist, 
authoritarian regimes to social demo- 
cratic market economies. But they 
share a major policy challenge: to In- 
crease economic efficiency and com- 
petitive performance while presan/ing 
socio-economic fairness and equity. 

Many advanced and developing 
economies are experiencing substantial 
political change in this decade. How 
politics will intersect with economic de- 
velopment goals and the pace of tech- 
nological change is yet to be decided. 
This web of complex relationships will 
ultimately affect what employment and 
training professionals are able to con- 
tribute in resolving employment prob- 
lems, and in taking advantage of inno- 
vative workforce and workplace 
possibilities. 
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. Editor’s 1^ y 



In the remaining part of this section 
on Evaluation Issues and ActivltieSi we 
turn to the Issue of the coordination/in- 
tegration of workforce development 
programs and services and their ac- 
countability requirements. We first ad- 
dress this issue at the national level, 
then at the state/local level. In discuss- 
ing expert opinion and research focus- 
ing on coordir^ation, we see the oon- 
cept of workforce preparation systems 
gaining wide acceptance at all levels of 



government. This concept has been 
welded to two existing characteristics of 
our employment and training efforts — 
I.e. decentralization and privatization. 
The new emphasis is on system-wide 
policy development, strategic planning, 
simplified and coordinated service de^ 
livery, and a common concept of ac- 
countability at the state and local lev- 
els. In this movement toward system 
development, the role of the federal 
government is yet to be determined. 
Defining rights and responsibilities at all 
levels is now laced with conceiiis about 













how we are to judge the performance of 
separata programs, and programs co- 
ordinated within workforce development 
systems. In the next series of articles 
we obtain a snapshot of federal efforts 
to Intv^grata human services, explore 
some of the problems in the existing 
E&T system now well identified through 
process and outcome evaluations, and 
discuss some of the issues Involved in 
developing strategies for measuring 
and judging performance — both in 
separate program^and in workforce 
sysfamsu^ 









Some Thinking 
About E&T 
Coordination at the 
National Level 

In this article we trace a bit of the 
history of national-level coordination 
efforts — admittedly a very selective 
piece of that history. We look at an in- 
teresting but little-known review of co- 
ordination efforts in 1991 prepared by 
the Inspector General’s Office in the 
U.S. Department of Health and Human 
Services, and at a more recent series of 
reports produced by the U.S. General 
Accounting Office. 

Lessons from Past Federal 
Efforts to Integrate Human 
Services Management and 
Delivery 

A rather extensive literature has ac- 
cumulated regarding human services 
integration since the 1970s. Services 
Integration: A Twenty-Year Retrospec- 
tive is an eye-opener in this respect. 

The tragic conclusion of this report, 
however, is that over the long haul 
“service integration effort nave had 
little institutional impact on a highly 
fragmented human services system.” 
The barriers the report identifies are fa- 
miliar: the system is too large, com- 
plex, bureaucratic, professionalized, 
and specialized. It lacks powerful sup- 



porters advocating coordination. And 
its funding arrangements mediate 
against coordination and integration. 

Studies of Services integration: 
Some Results of Interest 

Twelve reports detailing studies of 
service integration conducted between 
1972 and 1987 are reviewed for their 
major findings. Figure 1 provides an 
overview of some of the results these 
reports share in common. 

Recommendations 
in the IG Report 

The goal of earlier integration ef- 
forts, the report says, was major com- 
prehensive system reform — too high 
an expectation, the analysts claim. The 
evaluators suggest a more modest goal 
that reflects satisfaction with shorter- 
term, more incremental accomplish- 
ments. 

The Inspector General’s report also 
recommends a service provision focus 
on clearly-defined target groups, con- 
sistent with more manageable goals. 
Both recommendations underline the 
importance of goals which can be sus- 
tained politically and organizationally. 

The evaluators acknowledge that 
some degree of central control (federal 
control) over an otherwise complex and 
fragmented human service system is 
necessary. This would provide a needed 
external stimulus for integration ef- 



forts. Federal authority should have an 
oversight component also, according to 
the report, in terms of defining and 
measuring expected outcomes across 
programs. The analysts propose that an 
additional component of central control 
should be networking — that is, bring- 
4 ing individuals involved in integration 
efforts together to share information 
and build support across federal agen- 
cies and program bureaucracies. At tlie 
same time, the federal government 
needs to provide more funding flexibil- 
ity, they suggest, in order to rev/ard 
separate organizational entities for 
coming together. 

An Impetus for Coordination: 

The U.S. General Accounting 
Office Reports 

With increasing interest in deficit re- 
duction, recently the U.S. Congress has 
requested a series of analyses giving at- 
tention to the proliferation of federally- 
funded programs in various program 
areas. Two general reports in the em- 
ployment and training area, titled Mul- 
tiple Employment Programs, were pub- 
lished in June 1992 and July 1993. 
Subsequently, a series of reports were 
produced under the same general title 
but with the following subtitles: 

■ National Employment Training 

Strategy Needed 1993) 

■ Conflicting Requirements Hamper 

Delivery of Services (January, 1994) 
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1 TIrm constraints: service Integra- 
tion requires an evolutionary pro- 
cess that allows time to develop 
ilnkagesr gain support and legiti- 
macy, plan, organize, and imple- 
ment. 

a Negative attitudes and behavior 
regarding the concept of service 
integration on the part of system 
personnel. 



1 Moderate-scale service integra- 
ticn efforts are often more suc- 
cessful than large-scale compre- 
herjsive human service planning. 

a Human services organizational 
networks must be adapted to lo- 
cal environments. 



1 Improved service delivery acces- 
sibility. 

a Greater continuity. 



a The lack of cross-training of Stan 
and the development of ’'general- 
Ists.” 

4 Competition among providers. 

8 Unclear accountability expecta- 
tions. 

4 Differing funding rules/regulations. 

7 Different funding cycles, and fluctu- 
ations in the type ot funding and 



a Linkages are more readily devel- 
oped in stable rural envirenments 
than In large urban areas. 

4 Staff co-location often enhances 
coordination. 

5 R & D funds are essential. 



4 Increased efficiency. 

4 More effective assessment of client 
ne^s, and strategies for respond- 
ing to them. 



funding levels leading to an unsure 
resource base. 

8 Diuerlng program rules and proce- 
dures. 

0 Lack of timely, comprehensive and 
relevant data. 

10 High administrative costs. 

11 Organizational territoriality and po- 
litical opposition. 






0 Effective leadership and consen- 
sus-building are necessary. 

7 Long-term planning Is critical, in- 
cluding setting goals and develop- 
ing strategies for service integra- 
tion and Its funding. 

8 Political support is required. 



fl Most Federal Agencies Do Not 
KnoYf If Their Programs Are Work- 
ing Effectively (March, 1994). 

■ Overlapping Programs Can Add 
Unnecessary Administrative Costs 
(June, 1994). 

B Overlap Among Programs Raises 
Questions About Efficiency (July, 
1994). 

» Major Overhaul Needed to Create a 
More Efficient, Customer-Driven 
System (February, 1995). 

Conclusions in the Reports 

In the two earliest reports, the GAO 
found that 125 iedcral programs were 
providing some form of employment 
and training assistance to out-of-school 
youths or adults not enrolled in ad- 
vanced degree programs: 49 in the U.S. 
Department of Education; 30 in the 



U.S. Department of Labor. Many of 
these provided similar services and oth- 
er assistance to overlapping client pop- 
ulations. A number of problems were 
occurring: 

■ The federal network of employment 
and training (E&T) programs was 
sufficiently fragmented to be creat- 
ing difficulties for workers, employ- 
ers and program administrators. 

■ A lack of access for potential appli- 
cants to information about these pro- 
grams was creating confusion and 
frustration for those needing various 
kinds of services. 

■ Needs assessments were often being 
made by service providers with a 
vested interest in particular service 
“treatments,** 



■ Assessment and job placement assis- 
tance were often duplicative and 
wasted resources. 

■ Programs w'ere not tracking partici- 
pants* progress through programs or 
their outcomes effectively. 

In the midst of tliese problems, how- 
ever, the GAO was finding that a num- 
ber of states were reorganizing their 
E&T efforts to increase the coordina- 
tion of service delivery at the local lev- 
el. The GAO analysts recommended 
this kind of energetic coordination 
movement at the federal agency level, 
and the development of a national E&T 
policy and strategy. 

In the January 1994 report, the GAO 
summarized results from an intensive 
review of nine E&T programs primari- 
ly serving the economically disadvan- 
taged. They found them to have similar 
goals, often to serve clients with com- 
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mon characteristics, and to have paral- 
lel but separate ser\ace delivery sys- 
tems. These attributes, they concluded, 
led to unnecessary administrative costs. 
The evaluators also discovered con- 
flicting eligibility requirements and dif- 
ferences in eligibility criteria, compli- 
cating the eligibility determination 
process across programs. And differ- 
ences in annual operational and budget- 
ing cycles hindered administrators in 
coordinating their services with those 
of otlier programs. 

The February 1995 report character- 
ized the existing E&T system in this 
way: 

8 It was fragmented organizationally 
and in terms of service delivery de- 
spite common goals, overlapping 
client groups, and similar services. 

■ It was wasteful of resources. 

« Its administrative stmctures and 
functions overlapped. 

■ Separate funding streams reinforced 
program territoriality. 

■ It was difficult for clients and em- 
ployers to understand ways to enter 
and access the system, and learn 
about its services. 

B There was considerable data incon- 
sistency across programs even 
though measures were being collect- 
ed on similar variables. 

o There was a lack of objective infor- 
mation about programs for manage- 
ment and oversight purposes. Infor- 
mation systems did not allow 
analysts to learn about relationships 
between client characteristics, ser- 
vices and outcomes. 

■ Only modest E&T gains for partici- 
pants were identified in program 
evaluations. 



a Employers had difficulty obtaining 
qualified workers from the E&T sys- 
tem. 

Elements of Effective E&T 
Systems 

The GAO did not hesitate to suggest 

what an effective E&T system might 

look like. It should: 

■ Be customer-driven rather than pro- 
gram-driven. 

■ Provide easy access to services. 

m Involve an efficient use of resources. 

■ Offer a wide variety of E&T servic- 
es. 

■ Be accountable for the results. 

m Afford flexibility at the local level 
in determining how best to meet 
community needs. 

■ Move toward a consolidation of pro- 
grams. 

a Have clear points of entry to the sys- 
tem and identifiable pathways 
through the system for customers. 

m Negotiate a common set of require- 
ments and administrative procedures 
across programs. 

m Design its service delivery strategies 
in partnership with employers and 
unions. 

m Develop a data collev;tion system ca- 
pable of tracking participants, the 
services provided to them, and their 
outcomes across programs, in-state 
geographical areas, and states. 

■ Reduce administrative staffing for 
the system to a minimum. 

■ Develop clearly defined goals, mea- 
surable objectives, and performance 
standards. 



■ Utilize evaluation strategies for 
learning about the system’s effec- 
tiveness that are pragmatic as well as 
scientific. 

The GAO’s assessments and recom- 
mendations generally coincide with re- 
cent Department of Education and De- 
partment of Labor initiatives in 
education, training and employment, 
with state-level coordination efforts, 
and with local-level E&T agendas. 

These initiatives and efforts are 
moving workforce development in the 
direction of greater integration through 
state/local, private/public systems that 
are guided at the federal level by a gen- 
eral policy and strategy and by general 
accountability parameters, but which 
give states the major responsibility for 
pulling programs, services and data to- 
gether and developing methods for es- 
tablishing system accountability. 

Comments 

The HHS and GAO reports give us 
an updated perspective on the problems 
and possibilities in workforce prepara- 
tion. The concept of systems of pro- 
grams is the outcome. The 1970s’ and 
1980s’ notion of services integration 
was coordination at one level of such a 
system — at the local service delivery 
level. The modern boundaries of “sys- 
tem” include the policy, planning, man- 
agement and oversight levels as well. 






In a separate report produced in 
February 1995. the GAO provided a 
useful summary of its numerous reports 
and Congressional testimonies on the 
Department of Labor’s programs be- 
tween 1989 and 1995. The summary 
includes a review of DOL-funded pro- 
cess and net impact evaluations of 
these programs. 
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S\/leasurin9 
Performance in 
Programs and 
Coordinated 
Systems 

This article focuses more specifical- 
ly on some of the variables that are 
important to measure in performance 
systems coordinating data across pro- 
grams. It also addresses major data 
sources for obtaining such measures. 
Two national reports are reviewed: one 
emanating from the vocational educa- 
tion system, one from the employment 
and training field. Although these re- 
ports were written at the beginning of 
extensive state-level experimentation 
with comprehensive worl^orce devel- 
opment systems, the general themes are 
highly relevant to the measurement of 
performance in these systems, as well 
as to programs within them. 

Beyond Perfomence Standards 
by David Stevens and Jinping Shi 
of the University of Baltimore. 

Prepared in 1994 for the National 
Center for Research in Vocational Edu- 
cation (NCRVE), which is fimded by 
the U.S. Department of Education, the 
subject of this short paper is informa- 
tion production, expansion and coordi- 
nation. Traditionally, employment and 
training professionals and vocational 
education specialists, and those who 
evaluate these different sets of pro- 
grams, have practiced in relatively sep- 
arate worlds. Beginning in the late 
1980s, and now in the 1990s, Presiden- 
tial initiatives and federal legislation 
have been bringing these worlds to- 
gether, albeit gradually and sometimes 
reluctantly. At the same time, new 
workforce preparation councils and 
boards have been struggling to bring 
these professional tenitoiies together in 
a new way at the state level, at the 
same decisionmaking table, 

These new federal and state coordi- 
nation efforts have informed each 
group of experts about the other’s pro- 
fessional backgrounds, education, ex- 
perience, knowledge base, culture and 






Evaluation issues and ActWltfes « At the National Lq\yi 



linguistics. As a result, these highly 
trained individuals are taking greater 
interest in one another, and each oth- 
er’s policies and strategies for estab- 
lishing accountability. "Not unrelated to 
this new accomodation, there is signifi- 
cant movement toward a beginning 
consensus about the meaning ofpeifor- 
mance management. 

In this context, Stevens and Shi fo- 
cus on a major issue in performance 
management, the relationship between 
vocational educational “treatments” or 
interventions, and employment and 
earnings. Several questions concern 
them: 

■ What does information about this re- 
lationship tell us? 

■ What variables should be given at- 
tention? 

B How should these variables be mea- 
sured so that the indices are reliable 
and valid? 

Some Useful Variables in 
Studying the Relationship 
Between Vocational Education 
and Employment/Earnings 

The authors propose several catego- 
ries of variables that should be consid- 
ered, and which are often absent from 



databases. Figure 1 lists these, as ex- 
cerpted directly from the report. The 
authors propose that a training stu- 
dent’s labor market status can be 
thought of as a joint outcome reflect- 
ing three sets of influences; the stu- 
dent’s qualifications, tlie skill require- 
ments of employers, and employment 
opportunities. The multiplicity of influ- 
ences underscores the conclusion that 
we should not expect any single cause- 
effect relationship to exist between vo- 
cational education and labor market 
outcomes. 

To reinforce this position, the au- 
thors refer us to previous national as- 
sessments of vocational education that 
reached a similar conclusion. The Na- 
tional Institute of Education’s 1981 Vo- 
cational Education Study, for example, 
stated that research results concerning 
this relationship could not be interpret- 
ed as an assessment of the effectiveness 
of vocational education programs — 
because of general data limitations, but 
more importantly because of the diffi- 
culty in attributing either economic or 
noneconomic outcomes to participation 
in various kinds of vocational educa- 
tion training. And the authors report 
tliat the final monograph by the Nation- 
al Assessment of Vocational Education 
in 1989 concluded that “institutional 




Qualification Factors 
abilities 
motivation 
nonvocational education 
vocational education 
work experience 
other 

Requirement Factors 
skills 
other 

Opportunity Factors 
entry-level hiring 
retention 
promotion 
worksite learning 
continuing education 






to generate 



Observed Labor " ' 

Market Outcomes 
employment 
employment continuity/ 
mobili^ 
earnings 

change in earnings 
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performance may reflect not only dif- 
ferences in program quality but also 
differences in the types of students 
served/* Sheets and Shi clearly seek 
greater appreciation of these complexi- 
ties on the part of managers and evalua- 
tors. 

Quftliflcation Factors. These fac- 
tors refer to attributes employers tend 
to consider in making a judgment of a 
potential worker’s qualifications, in 
terms of initial hiring, retention in em- 
ployment, skills training, subsidized 
education, or promotion. For example, 
evidence of having reached a certain 
educational threshold, such as posses- 
sion of a certificate or degree, is a sig- 
nificant influence. The national skills 
board, part of Goals 2000, is expected 
to reduce dependency on program-com- 
pletion as a threshold, substituting in- 
stead skill competency thresholds con- 
sistent with the establishment of 
industry requirements and standards. 

Anotiier attribute may be an employ- 
er’s recruiting strategy. The authors ac- 
knowledge that “the value of an at- 
tribute as a discriminator among 
candidates falls as a fraction of those 
who offer the attribute rises.” However, 
they claim that in instances where few- 
er potential hires exhibit a particular 
valued asset, the qualification factor 
may enhance or diminish labor market 
outcomes associated with the training 
institution or program involved. Such 
qualification influences complicate per- 
formance measurement. For instance, 
the use of UI wage record data in the 
absence of additional information can 
either help or damage a vocational pro- 
gram. The message is that where you 
are dealing with more than one influ- 
ence on multiple outcomes, the inter- 
pretation of data on relationships be- 
tween these variables must be carefully 
qualified. 

Requirement Factors. The require- 
ments of employers interact with the 
qualifications of potential workers, 
making it difficult to understand causal 
relationships between training and em- 
ployment outcomes. Sheets and Shi 
point to problems faced in the Skills 
Standards Project, funded jointly by 
the U.S. Departments of Education and 



Labor, in agreeing on a definition of 
skills standards for industries. Two 
steps are involved: 1) defining the in- 
dustry itself, and 2) deciding whether 
the standard will be based on one of 
three kinds of thresholds — eniry-level 
perfonnance, the typical performance 
of those working in the industry, or 
leading-edge performance. 

In reality, each type of definition is 
influenced by changing technology, job 
availability and the qualifications of 
workforce candidates. Although UI 
wage record data can offer an opportu- 
nity to understand more clearly how 
worker qualifications and employer re- 
quirements fit, an intervening variable 
in this relationship must also be consid- 
ered, namely opportunities. 

Opportunity Factors. Job avail- 
ability and the nature of available jobs 
are two major opportunity factors. In a 
fast-paced economy, it is not possible, 
the authors recognize, to align skill ac- 
quisition with its use when the time- 
frames are short. However, worker 
qualifications and employer require- 
ments mean little if tliere are limited 
employment opportunities. 

isolating Cause-Effect 

Relationships from a 

Complex Mix of 

influences 

The authors* ultimate goal is to im 
prove vocational education managers’ 
understanding of the mixture of influ- 
ences affecting labor market outcomes, 
and hov/ these tend to define the rela- 
tionship between vocational education- 
al inteiventions and employment and 
earnings. The challenge, they say, is for 
managers to have access to enough ap- 
propriate measures to permit them to 
tease out the effects vocational pro- 
grams may be having on hiring and re- 
tention, and to merge this information 
with a database on employment out- 
comes. The use of wage record data is 
analyzed in this context, and the au- 
thors* conclusion is that it is a useful 
database for this purpose. 

Examples of fruitful coordination of 
databases, which include variables in- 
fluencing employment outcomes plus 



outcome information, were drawn from 
a four-state consolidated database de- 
veloped in 1991 by The Jacob France 
Center at the University of Baltimore, 
The goal of this project was to illustrate 
how wage record data could be com- 
bined with administrative data from 
state vocational education systems in 
order to conduct more extensive and 
useful management analyses. The 
project was successful in raising man- 
agers’ awareness of ways they could 
leam more about patterns in student ex- 
periences following their participation 
in programs. 

Earnings Profiles 

One example from the Center 
project was the identification of distin- 
guishable patterns in earnings profiles, 
which corresponded to descriptions of 
whether and when students experienced 
progress on a career path — that is, in 
jobs that involved “sustained affiliation 
with a single employer, and an observ- 
able increase in annual earnings.” 
Stevens and Shi identified five pat- 
terns: 

■ The traditional career path pattern: 
immediate and sustained earnings 
growth. 

* The delayed-start pattern: low ini- 
tial earnings following by sustained 
earnings growth. 

■ The short-circuited pattern: initial 
earnings growth followed by earn- 
ings reaching a plateau. 

■ The one-step improvement pattern: 
low initial earnings with discontinu- 
ity, followed by a higher but flat 
earnings path. 

» The dead-end pattern: flat or declin- 
ing earnings over time. 

The importance of distinguishing pat- 
terns, the authors believe, is in their use 
in monitoring earnings over time. The 
emphasis in such monitoring is on un- 
derstanding the “horizontal trajectory 
of earnings over time,” rather than de- 
pending on single point-in-time snap- 
shots. The longitudinal approach per- 
mits managers to look both at levels 
and directions of earnings. 
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Cautioning that these earnings pro- 
files shotild not be treated as gospel, 
the authors nevertheless propose that 
such ideal-type constructs contribute 
usefully to the debate over the rele- 
vance of training-related placement 
standards, and over the timing and use 
of snapshoi measurements of earnings. 
Neither do the profiles allow clcar-cut 
cause-effect judgments to be made. 

More must be known about a student's 
education subsequent to the vocational 
education treatments being examined, 
or about the work-based learning ac- 
quired. 

Even so, the Sheet and Shi analyses 
of data on the labor market experiences 
of ex-vocational education students 
three and one-half years following their 
completion of this education are very 
innovative. They alert us to important 
issues in data reliability and validity, 
and to the advantages of consolidating 
appropriate indicators for a range of 
critical variables in better understand- 
ing the effects of training programs. 

Wag9 Record Information 
Systenta* Office of Technology 
Aeseeement, U.S. Congress. 

Last year the Ojjfice of Technology 
Assessment (OTA) reviewed efforts by 
the National Occupational Information 
Coordinating Committee to encourage 
the use of UI wage records for conduct- 
ing policy studies and monitoring the 
outcomes of vocational education. The 
Committee had previously designed a 
series of demonstrations to explore the 
technical problems in producing and 
using wage records for this purpose. 
Subsequently it was to develop proce- 
dures for maintaining a nationally-ac- 
cessible database for wage record infor- 
mation. The Committee also contracted 
with MPR Associates to desi^ a train- 
ing guide to assist states in using wage 
record data for studying the outcomes 
of vocational education and other pro- 
grams. 

The purpose of this OTA research 
paper is to summarize what has been 
learned from the demonstrations and 
from other studies, to identify data 
quality issues, and to make suggestions 
about how the Congress could deal 



with some of these issues in the process 
of encouraging die development of a 
reliable, comprehensive wage record 
database. 

Purposes Served by Wage 
Record Information 

The OTA paper suggests four major 
purposes for UI wage data: 

■ To conduct research on trends in the 
employment and earnings of work- 
ers, and the employment effects of 
alternative strategies of income sup- 
port, education, training, and social 
services. 

■ To monitor and evaluate. specific ed- 
ucation, training, work/welfare and 
related social programs regarding 
their effects on the economic wel- 
fare of individuals, in order to make 
improvements — that is, for perfor- 
mance management. 

• To provide the public with informa- 
tion about the outcomes of pro- 
grams, and employment trends in 
different industries, occupational 
sectors, and geographic areas that 
support their decisions as customers 
of service. 

■ To enforce compliance with policies 
concerning eligibility and payments 
in other social programs. 

These purposes can be served by UI 
data universally, the report says, since 
90% of the U.S. working population is 
included in the UI wage record data- 
base. And three key data elements — 
the SSN of all employees covered by 
UI, their quarterly earnings, and the in- 
dustrial code or business name/address 
of the employer — are collected by all 
states. Furthermore, longitudinal earn- 
ings histories cait be constructed be- 
cause state agencies accumulate em- 
ployment and wage data over time. 

Obtaining Additional 
Employment and 
Wage Data 

For individuals not included in state 
UI information systems, information 
must be obtained from other sources, 



such as from other states, the federal 
government or educational institutions. 
This missing data is important, the 
OTA report states, since analyses that 
compare the outcomes of educational 
and training programs can be Uiisinter- 
preted in the absence of such data. Ob- 
taining data from other sources can be 
complicated, however, requiring specif- 
ic data-sharing agreements that assure 
confidentiality. 

To address the latter issue, the 1992 
JTPA Amendments requested the Bu- 
reau of Labor Statistics (BLS) to devel- 
op a plan for creating a National Wage 
Record Database (NWRD), which 
would pool all wage records in existing 
state unemployment insurance systems 
into a national database available to all 
states. Core data elements were to re- 
side in the states, or be sent to a central 
data bank operated by the federal gov- 
ernment. The database was to consist of 
a national sample of individuals, sam- 
ples within states, or the entire working 
population. 

Both the cost of maintaining a na- 
tional database and the confidentiality 
challenge remain a concern, according 
to the OTA report. The BLS has con- 
sidered proposing a statutory strategy 
for resolving the privacy problem. Or 
data confidentiality might be assured if 
wage record information were classi- 
fied as statistical rather than adminis- 
trative information. Another concern 
discussed in the report is whether the 
development of such a database would 
undennine the primary purpose of the 
UI information system in the eyes of 
employers and the public. Beyond these 
issues, there is some anxiety that the 
use of a national database for enforce- 
ment purposes might erode its function 
for performance management and eval- 
uation. 

The Level of State Use 
of UI Wage Records 

Under the 1988 amendments to the 
Deficit Reduction Act, states were re- 
quired to collect quarterly wage reports 
from all employers as part of a new In- 
come Verification and Eligibility Sys- 
tem. This vastly increased the number 
of data-shai*ing agreements. The Na- 
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tional Commission for Employment 
Policy reported a 50% growth in such 
agreements between 1986 and 199L 

The program providing the greatest 
experience in using UI wage records to 
track outcomes has been JTPA, the 
OTA report concludes. The use of 
JTPA data was a sufficiently important 
option that the U.S. Department of La- 
bor funded demonstration projects in 
1993-1994 to study this use vis-a-vis 
follow-up questionnaires forjudging 
compliance with JTPA performance 
standards. 

Meanwhile, in Floridans Education 
and 7 raining Placemeftt Information 
Program, UI earnings data were being 
combined innovatively with data from 
the state’s community college and uni- 
versity systems, the public schools, the 
state corrections system, and federal 
agencies. Employers were also sur- 
veyed to determine the occupational 
categories of all students tracked within 
the system. A common set of outcomes 
measures was used: quarterly earnings; 
weeks worked; occupations; further en- 
rollment in adult education, community 
college or higher education; and move- 
ment into the military. The consolida- 
tion permitted analyses of outcomes for 
all state education, training and em- 
ployment programs. This comprehen- 
sive data bank has become a basis for 
state strategic planning and budgeting. 

In 1992, Utie National Governors* 
Association reported tlnat 20 states had 
explored the use of UI wage data for 
tracking vocational education students, 
and 12 were using these data on a regu- 
lar basis. Washington State, for exam- 
ple, had combined 1) wage record data 
across five states wiAin its region with 
2) enrollment data from the state’s uni- 
versity system, and 3) employment in- 
formation from the U.S. Department of 
Defense. 

Some states had also estimated 
costs. In reviewing states’ information, 
the National Commission estimated av- 
erage development/operation costs for 
a wage record information system as 
approximately $1.75 per person 
tracked. In vocational education, one 
expert estimate was $3/pcrson. But 



they would otherwise — that is, 
they may dassift^ thenwlves in- 
conectly a$ belonging in indus- 
tries or jurisdictions with the low- 
est tax rates. 



start-up costs were considered to be 
higher than long-run average costs, and 
there was considerable uncertainty 
about what cost categories were includ- 
ed in these estimates. Also, no esti- 
mates were made of the cost of entire 
management information systems of 
which wage records were a part, to de- 
termine what propostion of the costs 
the wage record portion represented. 

One study reported by OTA, con- 
ducted by tile National Commission, 
compared the costs for UI tracking witli 
the JTPA follow-up system using ques- 
tionnaires. The estimate for the JTPA 
telephone survey was $1 9/per complet- 
ed interview. In this respect, the Florida 
system provided a reasonable bench- 
mark regarding the cost of comprehen- 
sive information systems — approxi- 
mately sixteen cents per person tracked, 
based on tracking 1.8 million people. 
Clearly there are large economies of 
scale. 

The OTA report asks us to view 
costs in the context of the length of 
time individuals are tracked. Attrition 
in survey samples increases with the 
length of follow-up. Such problems are 
virtually eliminated by the requirement 
in UI for a quarterly submission of 
earnings information. And the difficul- 
ty in locating members of the follow-up 
sample using the survey raises costs. 
The Commission estimated that the UI 
metliod cost only about one-fifth as 
much as the survey strategy. 

Quuiiity Problems wUh UI Data 

But the world of information sys- 
tems is never perfect. TIio OTA report 
takes the position that administrative 
sources of data are more difficult to use 
and interpret than data from surv^s 
where samples of respondents can be 
randomly selected and response catego- 
ries are under tlic control of the analyst. 
And there are some other problems. 
These were the major ones to which the 
report gives attention: 

B Wage record data are subject to sev- 
eral kinds of systematic errors. 

♦ Employct^^ tax liabilities may 
cause respondents to report dif- 
ferently to the UI system than 



❖ Employers may not report non- 
wage payments as accurately as 
they do wages and salaries. 

❖ Employers may report severance 
payments to dislocated workers 
only after these workers are ter- 
minated ftorn employment, 

❖ UI system policies may change, 
leading to changes in data defini- 
tions and measures that are poor- 
ly communicated. 

« The "matching rates” for the indi- 
viduals tracked in the UI system 
may be too high or too low. 

■ UI data may need to be obtained 
from multiple sources, with the pos- 
sibility of inaccuracies. 

The choices made about the number 
and kind of sources used can affect the 
"matching rate”, or “the percentage of 
all persons being tracked for whom 
some positive identification of employ- 
ment, unemployment or other activity 
appears in the outcome data.” This rate, 
the OTA report stated, is analogous to 
the response rate in questioimaire- 
based surveys. The Wgher the matching 
rate, the more trustworthy the results of 
data analyses > 

The OTA report says there me no 
clear-cut rules for deciding what the 
matching rate needs to be in order to 
avoid bias, Tlie suggestion is that this 
determination will require time, tlic ac- 
cumulation of state experience with dif- 
ferent configurations of data for differ- 
ent purposes, and specific studies 
comparing UI data with data from other 
sources. 

Issues to explore are differences in 
1) the rates of unemployment among 
the group tracked, 2) where these mdi- 
viduals are employed, 3) how they cam 
their income, and 4) the likelihood of 
their acquiring education, joining the 
armed forces, going to prison, or en- 
gaging in another activity. People who 
receive UI payments can be positively 
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idenlified. Those who do not receive 
them cannot be. More vocational edu- 
cation graduates continue on to further 
education than do JTPA completers, for 
e-Nample, and therefore the latter’s 
matching rates are higher. 

To increase the matching rates for 
different groups, the number of sources 
outcome data must be expanded, the 
report suggests. With vocational educa- 
tion students, for instance, outcome 
data can be requested from neighboring 
states, the home state’s higher educa- 
tion system, and the federal govern- 
ment. Some experts say a matching rate 
of 90% is needed. It is clear that a per- 
formance management system based 
only on wage record data from one 
state could be very misleading. 

The report also points out that local 
changes can st'^ongly affect the results 
of analyses ‘"when comparisons are 
made among specific institutions and 
programs rather than among statistical- 
ly-selected samples of individuals or 
institutions covering much larger ar- 
eas- 

B Earnings data arc affected by the 
quarter selected for reporting them. 
Some states compute annualized 
earnings. If the first quarter of the 
year is used as the basis, actual earn- 
ings will be overstated. Earnings are 
more accurately calculated if the 
fourth quarter is used. Therefore, in 
performance management systems 
where earnings are estimated on the 
basis of the first quarter’s worth of 
earnings, tlie results of analyses are 
likely to punish those programs with 
the larger proportion of graduates/ 
completers. Estimating earnings 
from four quarters of data, or adjust- 
ing for the quarter used could yield a 
very differc/jt result. 

w Analyses of wage data cannot con- 
itol for program effects due to 
differences in the background char- 
acteristics of individuals. Wage 
records do not include information 
on demographic characteristics, so- 
cial background, or years of work 




experience — all of which are relat- 
ed to employment and earnings. 

This information can come from 
program Management Information 
Systems, but dependence on these 
information systems would tend to 
limit wage record studies to popula- 
tions of individuals for whom there 
is such data. Without such informa- 
tion, employment and earnings 
trends emerging in analyses may be 
due more to changes in the composi- 
tion of the labor force than to pro- 
gram interventions. And the differ- 
ences in outcomes may be more 
related to differences in the charac- 
teristics of program participants than 
to program treatments. In terms of 
performance management, the OTA 
reports says, this lack of adequate 
data could lead to “creaming.” 

■ Wage records do not distinguish be- 
tween part-time and full-time em- 
ployment. There can be large differ- 
ences in the earnings estimates, the 
OTA report states, due to very small 
fluctuations in the proportion of in- 
dividuals working part-time rather 
than full-time. If “weeks worked” is 
included as a data element, analysts 
can restrict their studies to full-time 
workers. However, only seven states 
were collecting this element in 1994. 

m There are differences in the accura- 
cy ofUI records vis-a-vis survey in- 
formation. The New Jersey Unem- 
ployment Insurance Re-employment 
Demonstration Pnject found that 
earnings estimates for a sample of 
dislocated workers were higher if 
based on UI data on the first quarter 
after unemployment, than if based 
on surveys. In the second and fourth 
quarters, they were lower. The high- 
er figures in the foimer case were 
due to severance payments; the low- 
er figures were due to a growing 
number of workers occupying out- 
of-state jobs. The National JTPA 
Experiment found the same phenom- 
enon. Estimates of earnings of low- 
income individuals differed signifi- 



cantly between v/age record and sur- 
vey data. 

■ Earnings estimates may be different 
for different client groups. Low-in- 
come, disadvantaged populations 
appear to have more earnings from 
unreported sources than dislocated 
worker populations, for example. 
Systematic differences may then 
persist in the accuracy of earnings 
estima*?s for these groups. 

■ Differing earnings est' ^tes can be 
related to the scientific sophistica- 
tion of follow-up surveys: sampling 
procedures, questionnaire construc- 
tioHy interview formats, and methods 
of analysis. 

m Wage information recordkeeping in 
the UI system can be a source of er- 
ror, No large-scale audits of the 
system have been conducted, there- 
fore the nature of errors will not be 
known until the large BLS audit is 
completed. But the OTA analysts 
tliink it is likely that the quality of 
recordkeeping varies across states. 

Some Conclusions 

The OTA report concludes, as do 
most researchers, that “bad^data may be 
worse than no data,” They recommend 
that studies look at the relationship be- 
tween data quality and system design, 
as well as the other issues identified. 

The report offers recommendations 
relevant to BLS’s plan for the creation 
of a national wage record database. 
These are useful in framing information 
production issues. Given that the pur- 
pose of a national database would be 
policy research, program evaluation 
and consumer information, the report 
includes these suggestions: 

■ Congressional review of states’ ex- 
periences with the UI wage record 
system, the improvement of state 
studies using UI wage data in terms 
of their quality and utility, and the 
use of these data within performance 
management systems. 

■ Improvements in the federal govern- 
ment’s assistance to state user agen- 
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cies in utilizing wage record data in 
comprehensive workforce develop- 
ment systems. 

■ Development of federal/state dem- 
onstration projects to encourage the 
development of regional consortia 
that can promote the use of wage 
record data. 

M Conducting of systematic research at 
the federal level on the use of wage 
record data in policy studies and 
performance management systems, 
including program-specific and 
workforce system-oriented evalua- 
tion. 

Some Comments on 
the Two Monographs 

Interest in strategies for establishing 
accountability in public programs and 
systems has never been more intense. 
Despite barriers to coordination and in- 
tegration, the federal government, the 
states and local communities are mak- 
ing strong efforts in the 1990s to col- 
laborate, coordinate and consolidate 
workforce development programs, and 
to incoiporate within that movement a 
solid notion of howto judge process 
and performance. 

'ftTiatever the general approaches 
taken in establishing accountability, the 
adequacy, quality and accuracy of the 
information systems on which perfor- 
mance management judgments are to 
be based are critical issues. These two 
reports are useful in understanding 
some of these issues. They also force us 
to consider tlie potential imperfections 
in whatever direction we take in inte- 
grating information production, and en- 
courage us to seek ever-better systems 
for making essential decisions. 



Editor’s Note 



For more detailed information about 
some of the references mentioned, as 
well as related publicationa, please see 
the following: 

The Vocational Education Study: The 
Final Report, National Institute of 
Education, Vocational Education 
Study Publication 8, Washington, 
D.C.: U.S. Department of Education, 
1981. 

National Assessment of Vocaiiona! Ed- 
ucation — Final Report, Volume /, 
Summary of Findings and Recom- 
mendations by J. Wirt et al. Wash- 
ington, D.C.: U. S. Department of 
Education, 1989. 

Using State Unemployment Insurance 
Wage Records to Trace the Subse- 
quent Labor Market Experiences of 
Vocational Education Program Leav- 
ers by D. Stevens. National Assess- 
ment of Vocational Education. 
Washington, D.C.: U.S. Department 
of Education, 1989. 

Using State Unemployment Insurance 
Wage Records to Construct 
Measures of Secondary Vocational 
Education Performance by D. 
Stevens. Washington, D.C.: Office of 
Tedinology Assessment, U.S. Con- 
gress, 1989. 

Systematic Bias in Earnings Data De- 
rived from Unemployment Insurance 
Wege Records and Implications for 
Evaluating the Impact of Unemploy- 
ment Insurance Policy on Earnings 
by P. Decker. Princeton, NJ: Mathe- 
matica Policy Research. 1989. 

Policy Evaluation and Archived Wage 
Record Data: Limitations of Existing 
Data Sets by J. Bishop. Washington, 
D.C.: Northeast/Midwest institute, 
1989. 



Employment and Earnings Dynamics in 
the 1990s: Policy Issue Needs and 
Potential Uses of Nationally Ar-. 
chived Ul Wage Records by C. King. 
Washington, D.C.: Northeasl/Mid- 
west Institute, 1989. 

A Feasibility Study of the Use of Unem- 
ployment insurance Wage-Record 
Data As An Evaluation Tool for JTPA 
by J. 8aj et al. Washington, D.C.: 
National Commission for Employ- 
ment Policy, 1991. 

Schools and Labor Market Outcomes 
by D. Crawford et al. National Cen- 
ter on the Educational Quality of the 
Workforce. Philadelphia, PA: Univer- 
sity of Pennsylvania, 1992. 

Sfafe Systems for Accountability in Vo- 
cational Education by M. Rahn et ai. 
National Center for Research in Vo- 
cational Education. Washington, 
D.C.: U. S. Department of Educa- 
tion. 1992. 

The Schooi-to-Work Transition of High 
School and Community College Vo- 
cational Program Competers: 1990- 
1992 by D. Stevens. National Center 
on the Educational Quality of the 
Workforce. Philadelphia. PA: Univer- 
sity of Pennsylvania, 1993. 

State Capacity to Use Ul Wage 
Records: The Vocational Education 
Experience by L Amico. Washing- 
ton, D.C.: National Governors’ Asso- 
ciation, 1993. 
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More About 

Performance 

Management 

Reviewed in this article are two 
guides for developing performance 
management systems: Getting Results: 

A Guide for Government Accountabili- 
ty published in 1991 , and A Guide to 
Strategic Planning for Petformance 
Measurement, Reporting and Improve- 
ment Systems produced in 1994. Devel- 
oped by the Council of Governors* Pol- 
icy Advisors and the National Institute 
for Literacy respectively, these guides 
offer assistance to policymakers, plan- 
ners and oversight staff in developing 
viable, useful accountability systems. 
Both guides direct their suggestions to 
state governments. 

The Council of Governors’ Guide 

Authored by Jack A. Brizius and 
Michael D. Campbell, Getting Results 
was funded by the U.S. Department of 
Health and Human Services, and in- 
volved an array of experts on perfor- 
mance management. The authors ex- 
plain that the guide answers a number 
of basic questions: 

u What is a performance accountabili- 
ty system? 

H What is the political and policy con- 
text within which accountability sys- 
tems must be implemented? 

■ What are the key components of a 
workable accountability system? 

a What are the fundamental queries 
that must be answered in defining 
such a system? 

K What are the specific actions that 
need to be taken in implementing 
this kind of system? 

B ’'What are the problems and pitfalls 
in making comparisons and report- 
ing performance? 

■ How can accountability systems be 
institutionalized within state govern- 
ment? 

The appendix of the guide suggests 
a step-by-step progression toward com- 
pletion of a design for an accountability 
system on the basis of which judgments 



can be made confidently about the 
quality of policy and program out- 
comes. 

Defining Accountability 

The authors* definition of, perfor- 
mance accountability is at once useful: 
a means of Judging policies and pro- 
grams by measuring their outcomes or 
results against agreed-upon standards.** 

In this sense, accountability efforts pro- 
vide a framework for measuring out- 
comes as well as processes, and 
organizes this information “so that it 
can be xised effectively by political 
leaders, policymakers and program 
managers.** Accountability systems are 
to provide feedback of information to 
these important groups so that policies 
and programs can be adjusted when 
needed. And they are to disseminate 
useful information to service providers, 
service customers, and the public. 

Developing Accountability 

Systems 

The authors make the usual observa- 
tion that performance accountability 
differs from traditional assessments of 
“inputs** by focusing attention on 
changes in people*s lives. However, 
they do not neglect the importance of 
studying program implementation as an 
integral part of performance manage- 
ment. Nevertheless, they emphasize the 
establishment of performance standards 
which they contend tie desired out- 
comes to longer-term program goals. 
These standards, they say, must be real- 
istic estimates of expected outcomes 
which have been jointly developed by 
those judging performance and those 
being held accountable. Some criteria 
for system development are: 

■ The amount of resources used. 

a The baseline skill levels or problems 
of those served. 

■ The intensity of a service or treat- 
ment. 

■ The power of the incentives used to 
produce change. 

It is to the authors’ credit that per- 
formance accountability systems, as 
they define them, are not the end-all in 
judging policies or programs. Judging 
effectiveness, they say, requires rigor- 



ous controlled impact evaluations. This 
conclusion is consistent with other cur- 
rent definitions of the boundaries of 
performance management systems — 
i.c. they lend to isolate net impact eval- 
uation from performance management. 

Characteristics of 

Accountability 

Systems 

The authors distinguish also be- 
tween policy accountability and pro- 
gram accountability. Policy account- 
ability is viewed as giving attention to 
the outcomes for whole groups or 
classes of people, not only for those 
who have participated in particular pro- 
grams. Program accountability looks at 
outcomes only for those served by a 
program or group of programs, and at 
how programs are operating. Brizius 
and Campbell describe usefully the key 
elements of state perfomiance account- 
ability systems, in the ideal: 

■ A focus on outcomes. 

B The use of a few selected indicators 
to measure performance. 

■ The generation of data over time. 

m Continuous reporting of outcomes. 

■ The use of performance information 
to create incentives to service pro- 
viders to improve outcomes. 

■ The use of performance information 
as a basis for developing sound 
questions for evaluation purposes, 
and for conducting competent evalu- 
ations. 

■ The utilizati^^n of performance infor- 
mation in making policy and pro- 
gram management decisions, and 
improving policies and programs. 

■ The testing of policy premises. 

These benefits of performance ac- 
countability, or performance manage- 
ment systems, are qualified by some 
limitations. Again Ae authors take the 
position that such systems are not capa- 
ble of determining the ultimate impact 
of programs and policies on people. 
Because impact evaluations are diffi- 
cult and expensive, they say, net impact 
evaluations arc “seldom used as man- 
agement tools.’* Therefore perfor- 
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mance management systems cannot 
definitively pronounce policies or pro- 
grams failures. The author’s persistence 
in viewing evaluation as something 
apart from performance management is 
an unfortunate and possibly misguided 
conclusion, since in general net impact 
evaluations produce the most accurate 
information for both policy and man- 
agement use, and are not always expen- 
sive. 

More to the point, accountability 
systems are considered by the authors 
to be limited by data quality and the 
accuracy of outcome measures, prob- 
lems that have a significant influence 
on evaluation activities as well. The au- 
thors also recognize that accountability 
systems can involve disincentives on 
the part of service providers to respond 
directly to the needs of clients given 
their situations and circumstances. This 
is particularly true, they say, when ac- 
countability systems are linked closely 
to the allocation of resources. 

The Design of Systems 

The authors explain tlie design of 
performance accountability systems as 
answers to five key questions: 

B Are the goals and objectives of the 
policy or program stated clearly? 

■ How can progress toward these 
goals be measured? 

B How can incentives be accomodat- 
ed? 

B How will the data be reported and 
used? 

■ How can policy development and 
program management be coordinat- 
ed to promote accountability? 

Realistic, measurable goal statements 
are an essential first step. Policy goals, 
in the guide, are essentially system- 
wide goals. Program objectives are 
more specific statements with shorter 
timeframes. Developing indicators of 
progress toward goals and objectives is 
the most difficult step, according to 
Brizius and Campbell. Such indicators 
should include both process variables 
and outcome variables. Performance 
standards then rely on the selection of 
these indicators. The authors caution 



states not to develop formal standards 
prior to the application of a policy or 
the operation of a program — a wiser 
process is to develop and test initial 
standards against actual program per- 
formance and adjust these standards 
based on experience with their use. 
Apart from premature use, performance 
standards have been greeted with 
mixed reviews because they have often 
been linked to funding decisions. Also, 
local economic and political conditions 
clearly affect performance but are not 
considered re^istically in the context 
of uniformly-applied standards. 

Some Conclusions 

The authors are well aware that ac- 
countability systems can have short 
lives if their advocates are not careful 
in designing and using them, and in 
mediating traditional objections to per- 
formance measurement. When account- 
ability systems identify problems, there 
will be natural pressures to dismantle 
them. 

A number of strategies are suggested 
for maintaining these systems. The cen- 
tral theme is ensuring that key stake- 
holders have access to and use account- 
ability infonnation: political leaders, 
policy staff, legislators, and legislative 
staff, program administrators, service 
providers, consumers of service, the 
press and the public. 



The National Institute for 
Literacy’s Guide 

WTiile the Institute’s monograph is 
directed toward developing accountable 
state adult literacy systems, particularly 
the states that participated in Utie Acad- 
emy on Performance Accountability 
held in Washington, D.C. in 1993, the 
insights are widely applicable. The 
guide is to assist slates in establishing 
statewide outcome-oriented perfor- 
mance measurement, reporting and im- 
provement systems, formally referred to 
as PMRISs. Their elements are generic. 

A PMRIS measures outcomes, re- 
ports this information to key actors, uti- 
lizes it to continually improve state pol- 
icies guiding programs and the quality 
of those programs. Its structural core is 
an interagency team composed of di- 
rectors of relevant statewide programs 
The team is the vehicle for making sure 
that outcome information is collected 
and reported, that it addresses policy 
resource allocation, management and 
service provider needs, and that coordi- 
nation across programs is maintained. 
The authors outline a series of steps in 
constructing a PMRIS, which are pre- 
sented in Figure 1. 

In this scenario, a vision statement is 
2i preferred future that explains the con- 
ditions and life quality to be achieved 
in the state. Benchmarks are measur- 
able goals for the state as a whole. 



Figure t ; 



1. Define vision and benchmarks. 

2. Define po//cy oufco/nes. 

3. Identify performance for 

poiicy outcomes. 

4 . IdenHfyprogramoufoomee, related 
to poiicy outcomes. 

5. Identify program performance 
measures. 

8. \der\i\fy target populations, related 
to policy and program outcomes. 

7. Compare existing service delivery 
patterns with service needs: 
w Determine what program intorven- 
tiens are necessary to achieve 
outcomes for target groups. 
n Determine whether existing pro- 
giram can achieve these out- 
comes. 



I Apply quality standards to existing 
and new programs. 

8. Collect data & communicate results 

■ Define the audiences. 

■ Develop sample reports for differ- 
ent audiences. 

• Negotiate data collection protocols. 

■ Collect the data. 

■ Report the resultb. 

i. Use information from PMRIS to Im- 
prove program interventions. 

■ Link inputs to processes. 

m Identify constraints and enabling 
influences. 

■ Plan for continuous improvement 
10. Use information from PMRIS to 

adjust resources and policies. 
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consistent with the vision. Benchmarks 
permit the tracking of progress toward 
the vision over time. A rigorous defini- 
tion of vision and benchmarks, howev- 
er, is not viewed as a necessary condi- 
tion for defining poHcy outcomes — 
even though the latter need to be gener- 
ally consistent with these abstractions. 
The authors are insistent, however, that 
policy outcomes be quantifiable. 

In logical sequence, defining pro- 
gram outcomes is a next step, consis- 
tent with policy outcomes. These out- 
comes are defined by the authors as the 
statuses to be achieved by programs 
and their participants if policy out- 
comes are to be achieved. Performance 
measures are seen as both quantitative 
and qualitative indicators of such out- 
comes. These measures are considered 
the central element of the PMRIS. Per- 
formance measures are of three kinds, 
the authors say: results-oriented mea- 
sures; measures of program quality: 
and measures oi participant character- 
istics. These process and outcome mea- 
sures are dearly the building blocks of 
any performance management and 
evaluation system. 

Some Comments on Other 
Performance Management 
Approaches of the PMRIS 

National-level conceptualizations of 
performance management systems are 
quite similar in their basic elements and 
meaning. They have given considerable 
direction to states at a time when states 
themselves are recognizing the need to 
integrate related programs and assure 
the accountability of multi-program 
systems. Most performance manage- 
ment concepts include measures of pro- 
cess and outcome variables, even 
though the systems are outcome-driven. 
This moderates the pendulum swinp of 
the past several decades in which either 
process or outcome variables were the 
exclusive focus. This recognizes the 
strong interrelationship between 1) pol- 
icy and program implementation struc- 
tures and processes, and 2) the shorter 
and longer-term outcomes and impacts 
of related policies and programs — and 
the 3 ignificance of this relationship in 
judging policies and programs. 

The test of these well-conceived and 
logically explained ideal-type construc- 



tions of performance systems is the ex- 
tent to which they work in practice. 
Historical attempts to coordinate sepa- 
rately-funded programs providing com- 
parable interventions to comparable 
client populations have had mixed re- 
views, The new view of performance 
management depends on such coordi- 
nation. Relevant to this issue is the Na- 
tional Conunission for Employment 
Policy’s 1994 position paper ^Guiding 
Principles for Change,” by Anthony ?. 
Camcvale, the Commission’s chair. 

The paper explores some of the coordi- 
nation problems sustained historically, 
and m^es the following reconunenda- 
tions for national-level efforts to increase 
coordination in the context of national 
and state efforts to build accountable 
workforce preparation systems: 

m A national dialogue is needed on 
systemic reform of the national edu- 
cation and training systems. 

a The consolidation of programs serv- 
ing similar target groups should be 
endorsed. 

m Two interim steps for enhancing co- 
ordination should be implemented: 

1) the establishment of a central 
waiver authority outside the Execu- 
tive Branch, and 2) efforts to make 
basic program requirements compat- 
ible. 

B Broad planning and oversight re- 
sponsibilities at the federal, state and 
local levels should be promoted. 

■ Information about “best practices” 
regarding planning and oversight 
functions and tasks should be made 
available to state and local adminis- 
trators* 

■ More flexibility should be allowed • 
in the development of state-wide 
and local-level planning councils or 
boards. 

■ Funds for state/local capacity-build- 
ing should be provided. 

■ Comprehensive cross-program man- 
agement information systems 
should be developed* 

■ A UI wage record database, includ- 
ing all states, should be developed at 
the national level. 



mm 

Using Performance 
Standards In 
Establishing 
Workforce System 
Accountability 

There is a high level of agreement 
among workforce development experts 
that a key element in establishing ac- 
countability in new state-wide work- 
force preparation systems is the devel- 
opment of performance standards 
consistent with system goals and de- 
sired outcomes. Unfortunately we lack 
a history of experimentation to rely on 
for insights regarding the appropriate- 
ness of setting standards for “systems*' 
of programs. Even our exploration of 
the use of performance standards in 
separate major ongoing national pro- 
grams is recent. 

The} longest running experiment is in 
JTPA. What we have learned about the 
implications of using performance stan- 
dards in JTPA should be enlightening 
regarding the tradeoffs we may experi- 
ence in applying standards to state 
workforce development systems. 

One of the most astute analyses of 
the utility of developing and applying 
performance standards is Burt Bar- 
now’s chapter on “The Effects of Per- 
formance Standards on State and Local 
Programs,” in Evaluating Welfare and 
Training Programs edited by Charles 
Manski and Irwin Garfinkel in 1992. 
The book began as separate but related 
papers comnussioned for a national 
conference on evaluation methodology 
by its cosponsors, the Institute for Re- 
search on Poverty at the University of 
Wiscoitsin-Madison, and the Assistant 
Secretary for Planning and Evaluation 
in the U.S. Department of Health and 
Human Services. It is important to con- 
sider Bamow’s position on perfor- 
mance standards as we move closer to 
national employment and training poli- 
cy supported by performance standards, 
and to state-level workforce systems at- 
tempting to include standards in their 
performance management subsystems* 

Some Background 

The mandate to develop perfor- 
mance standards for major national 
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programs, as a major tool in the ac- 
countabiU^y kit, began in the 1980s. It 
now applies to JTPA, JOBS, and the 
Food Stamp Employment and Training 
Program. Performance standards were 
to involve specific measures of desired 
outcomes, tempered by lessons from 
previous program evaluations regard- 
ing the actual level of success employ- 
ment and training programs were hav- 
ing in increasing the employment and 
earnings of different participant groups, 
— and in the case of JOBs and Food 
Stamps, in reducing participants’ de- 
pendence on the welfare system. 

In the Manskl'Garfinkel lK>ok, Bar- 
now first defines E&T performance 
management, then outlines state and lo- 
cal objectives and behavior vis-a vis 
standards, and ends with his view of 
bow performance is measured, rein- 
forced and rewarded. In the process we 
see some cautions emerging. 

The Performance Managenr^ent 
Concept 

Bamow defines performance man- 
agement as “a system whereby pro- 
grams are systematically judged against 
specific objectives.” The following are 
the main interrelated “parts” within the 
performance management “system:” 

■ Performance measures: indicators 
of the performance of the entities 
being judged. 

■ Performance standards: specific 
standards associated with each mea- 
sure or indicator. 

• A standard-setting method: the 
method for setting standards may be 
based on statutory regulations, man- 
agerial goals, performance levels in 
other programs, or on other factors 
— or on arbitrary decisions. The 
most useful, and perhaps the fairest, 
Bamow claims, is a rational method 
that is imderslood in the programs 
being judged, even thou^ standards 
can be set to take account of factors 
that vary with the characteristics of 
the program being judged. 

* A rewards and sanctions system: 
such a system is a way of benefiting 



programs that meet or exceed stan- 
dards — such as through more pro- 
gram flexibility or funding — and 
sanctioning them for failing to do 
so. Sanctions may be mild, such as 
simply an absence of praise, to quite 
harsh, such as a loss of funds. 

Bamow' wants us to distinguish 
among three different concepts in talk- 
ing about performance standards: per- 
formance management, the achieve- 
ment of economic efficiency, and 
evaluation. 

Performance management is con- 
cerned with the achievement of an ar- 
ray of program goals, Bamow says, in- 
cluding equity. It is an ongoing 
oversight activity that provides con- 
tinuing feedback to policymakers, ad- 
ministrators and planners about key 
program processes and shorter-term 
program outcomes. Performance stan- 
dards, within performance manage- 
ment, do not include impact measures, 
Bamow states, and are less intrusive 
than evaluations in terms of disturbing 
program operation. However, perfor- 
mance management systems lack a 
clear-cut “bottom line” (such as prod- 
ucts sold) similar to variables tliat can 
be monitored in private sector activi- 
ties. 

Evaluation, Bamow proposes, fo- 
cuses on program impact through sin- 
gle snapshots in time, using quasi-ex- 
perimental or experimental research 
designs. Economic efficiency remains 
undefined, and its relationship to per- 
formance management and evaluation 
is left unclear. 

These distinctions are not the tradi- 
tional ones. The concept of “perfor- 
mance management system” often cov- 
ers both program monitoring and 
program evaluation, and involves some 
effort to use measures of economic effi- 
ciency in the process. Program evalua- 
tion typically covers judgments of pro- 
gram organization and operation, 
program outcomes, net program im- 
pact, and the tradeoff between costs 
and benefits. In this sense it involves a 
study of both program efficiency (do 
the program’s outcomes warrant its 
various costs?) and program ejfective- 



- 



ness (does the program achieve its pro- 
grammatic goals for those it is intended 
to serve?). 

Performance management systems, 
as theoretical constructs, have tended to 
involve three key “accountability” 
functions: program review (against 
plans), program monitoring (for com- 
pliance with requirements), and pro- 
gram evaluation (to judge the efficient 
achievement of program goals). But all 
of these constructs emphasize the con- 
tinuous feedback of evaluative infor- 
mation for continually improving pro- 
grams, an emphasis missing till 
recently in the evaluation research liter- 
ature. 

The Need for Performance 
Management Systems 

Bamow’s rationale for developing 
formal performance management sys- 
tems is significant. Briefly, such sys- 
tems 1) identify poor performers and 
therefore permit corrections to be 
made, 2) locate high performers and re- 
ward them, thus helping to define “best 
practices” and providing evidence that 
there is organizational profit in apply- 
ing them, and 3) maintain efforts in the 
direction of accomplishing the goals 
originally intended for the program. 
Identifying the ingredients in com- 
mendable performance also provides a 
practical basis for teplicating those at- 
tributes. Furthermore, sustaining-con- 
sistency with program goals reduces 
natural tendencies to redirect program 
activities toward other agendas, such as 
those responsive to political, cultural or 
organizational pressures. 

Important Kinds of Performance 
Measures to Consider 

Bamow identifies a range of vari- 
ables for which specific measures 
should or could be developed within 
performance management systems: 

Gross Outcomes 

Gross outcomes are measures of a 
program participant’s status at the time 
he or she exits from a program, or 
shortly thereafter, vis-a-vis certain de- 
sired outcomes — educational, skill 
training, employment, welfare reduc-^ 
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tion, etc. Exit status could mean at the 
completion of the services assigned, or 
simply at the point participants leave 
the program for various identified and 
unknown reasons. Bamow says that 
most of the outcomes measured in cur- 
rent national E&T programs are gross 
outcomes, because they do not neces- 
sarily KfSsct program gains or losses. 

Outcomes such as completion of ed- 
ucation, completion of skills training, 
placement in a job, and increased earn- 
ings in employment are standard pro- 
gram outcomes in E&T programs. If 
we were not able to compare the quali- 
ty of educational, skills training or em- 
ployment outcomes for program partic- 
ipants with comparable people who 
were not exposed to the program, we 
would designate these outcomes as ^e 
program’s gross outcomes ~ meaning 
that we are unable to label these as bet- 
ter (a gain) or worse (a loss) than the 
situation similar people would experi- 
ence in the absence of the program. If 
we were able to make the comparison 
indicated, we could then calculate the 
program’s net outcomes (by subtracting 
any loss or adding any gain). These net 
outcomes are usudly referred to as the 
program’s net impact. 

The main thrust of Bamow’s argu- 
ment is that gross outcomes are rela- 
tively easy to collect and analyze, and 
therefore constitute an efficient part of 
any performance system. He qualifies 
this by pointing out that performance 
standards that rely on gross outcome 
measures must adjust for differing cli- 
ent profiles. Otherwise programs will 
be sanctioned for not meeting perfor- 
mance standards, even though the char- 
acteristics of certain subgroups within 
the client population make it unrealistic 
to hold these subgroups’ gross out- 
comes hostage to the same levels of 
performance as one does the others. 

Net Outputs 

Bamow is referring here to indica- 
tors o{ gains, such as in education, 
skills, work experience, wages, and job 
retention. He claims that developing 
such measures will require a compari- 
son of different kinds of program inter- 
ventions, or treatments, such as differ- 
ent types of skills training (basic 



education, preemployment, job-specif- 
ic), which are difficult to quantify. The 
advantage of these measures, however, 
is that net earnings gains, can be con- 
sidered to reflect the market value of 
varying kinds of training. 

The problem is that different earn- 
ings gain measurement strategies may 
produce disparities in earnings gain es- 
timates, leading to a mistrust of this 
version of program performance. Also, 
using the determination of earnings 
gains as the most prominent way to 
judge a program’s achievements re- 
quires quasi-experimental or experi- 
mental net impact evaluations, which 
are not always appropriate or possible. 
Furthermore, Bamow cautions that pri- 
mary reliance on a quantitative eco- 
nomic measure of performance runs the 
risk of precluding a consideration of 
significant program outcomes that are 
less tangible but may be as important or 
more so. 

Inputs and Process Measures 

Bamow views input measures, such 
as the characteristics of participants, as 
part of performance management sys- 
tems. Process variables describing how 
service delivery is organized, what pol- 
icies and practices are involved at each 
step in the service pathway, how many 
and what kinds of clients experience 
what steps, and what the “culture” of 
the program is like (staff attitudes and 
behaviors, for example) are clearly in- 
cluded in a competent performance 
management system. As an expert in 
designing and conducting net impact 
evaluations, it is understandable and 
important that Bamow suggests that ex- 
clusive reliance on inputs and process 
variables is a mistake. 

Measures of Costs 

Performance management systems 
must, Bamow believes, consider the 
use being made of resources. Identify- 
ing the total dollars spent in achieving 
key outcomes is one approach. Or costs 
can be reported for each major out- 
come, such as cost per entered employ- 
ment. Separate cost measures give at- 
tention to unit costs, an approach 
Bamow thinks is very useful. But he 
cautions that if the cost measure is not 



properly combined with outcomes mea- 
sures, it may “promote underinvesting 
in participants and seiving participants 
who require less training.” Omitting 
costs from the performai»ce manage- 
ment system avoids a bias toward 
shorter and less intensive programs. 

The tradeoffs are difficult to reconcile. 

Combining Performance 

Measures into an 

Overall index 

Bamow proposes that, in theory at 
least, it is possible to develop a single 
overall measure of the economic gains 
from E&T programs, such as “the 
present value of all earnings gains re- 
sulting from the program, or the 
present value of earnings gains plus 
welfare savings.” While useful, this di- 
rects attention to a single indicator of 
performance, ignoring other outcomes. 

To avoid excluding other program 
goals, such as service equity, perfor- 
mance measures can be developed 
which hold programs to more of their 
promises -r- for example, measures of 
the participation levels of client groups 
of special interest — which can be in- 
corporated within performance stan- 
dards (as minimum levels of participa- 
tion.) Outcome measures can be 
tracked for different groups, and a dif- 
ferent set of minimum standards devel- 
oped for each. Employment retention 
may be a higher priority in some pro- 
grams than earnings gains. The reduc- 
tion of welfare rolls may be more im- 
portant than any other outcome. 
Performance measures, and ultimate 
standards, Bamow suggests, can be de- 
veloped so as to permit different expec- 
tations for program performance. 

The challenge in the use of multiple 
measures, he says, is in linking a clus- 
ter of measures together such that an 
overall minimum level of performance 
can be established, and a reward/sanc- 
tion system developed. A simple meth- 
od is to count all performance measures 
equally and sum the scores. But Bar- 
now warns us that adding scores may 
be undesirable. Some measures may be 
considered more important than others. 
Some may involve more variation than 
others, and therefore have to be weight- 
ed differently. An alternative is to 
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group performance measures and re- 
quire programs to meet a certain num- 
ber of standards in each group. 

A Rewards and Sanctions 
System 

Another important component of a 
performance management system, re- 
ward/sanction systems, also has its 
complexities. The least complicated 
strategy is to offer praise for successful 
compliance through certificates or an 
honor roll. A more energizing strategy 
is to provide additional funding, ac- 
companied by more flexibility in the 
use of fimds. A monetary reward is 
more consistent with private sector sys- 
tems. 

Inadequate performers, Bamow sug- 
gests, could lose the privilege of oper- 
ating a program, or the federal funds 
could be reduced. Or program adminis- 
trators Sould be required to accept re- 
medial technical assistance, as in JTPA. 
T>dng the level of rewards to the level 
at which standards are exceeded is an 
option already mandated in some feder- 
al legislation. However, funding re- 
wards and penalties may actually be 
counterproductive, Bamow says, if 
more funding leads to new responsibili- 
ties or declining funding denies servic- 
es to a burgeoning client population. 
The Achilles heel here is that a lack of 
consideration of the characteristics of 
participants may encourage program 
administrators to “cream” for those 
most likely to succeed in the labor mar- 
ket. 

Performance Standards and 
Measuring Economic Efficiency 

According to the author, judging a 
program’s “return on investment” is a 
key objective at all levels of govern- 
ment. In discussing ways to address 
economic efficiency in performance 
management systems, Bamow focuses 
on two issues: reductions in transfer 
payments and substitution effects. Cost/ 
benefit analyses have tended to treat a 
particular loss to clients as a particular 
gain to taxpayers — that is, reduced 
welfare transfers equal reduced taxes 
for others. This tradeoff may sound 
simplistic but it is implicit in most E&T 
legislation. The substitution problem is 




more difficult to deal with. Bamow 
says “if the gains in earnings accruing 
to participants are at the expense of 
other workers, then not all the private 
gains are social gains.” 

Bamow says that giving substitution 
effects due consideration involves ad- 
dressing two types of equity issues: 

1. The value placed on successfid out- 
comes for particular subgroups of 
clients. Earnings gains realized by 
certain kinds of participants may be 
viewed as more valuable from a so- 
cietal perspective than the same 
gains experienced by other clients. 

2. The value placed on a broad vs.a 
more narrow service delivery re- 
spome. Programs serving a large 
number of eligible people but with 
limited services may be considered 
more valuable than programs serv- 
ing a smaller number but with a 
more intensive mix and sequence of 
services. 

These issues complicate the devel- 
opment of performance standards, since 
they involve policy decisions laced 
with value judgments. Nevertheless, 
Bamow recommends that such issues 
be studied in developing performance 
management systems. 

The JTPA Performance 
Standards System 

The author sorts out the advantages 
and disadvantages of an established 
performance management system that 
has been fine-tuned over the 1990s — 
the system for JTPA. This system has 
been successful, Bamow thinks, in 
terms of its practicality, the level of ac- 
ceptance by state and local stakehold- 
ers, and the richness of its database. 

The best empirical evidence to date 
suggests, however, that JTPA perfor- 
mance standards have led to efforts to 
enroll those clients defined as easiest to 
place in jobs. 

However, he also points to an evalu- 
ation of JTPA by SRI in 1 988 , spon- 
sored by the National Commission for 
Employment Policy, which indicated 
that although the performance manage- 
ment sy:rtem created some incentives 



for creaming, JTPA service delivery ar- 
eas (SDAs) which gave priority to 
goals other than achieving high scores 
on performance standards were able to 
resist biasing the program enrollment 
process. The most prominent of these 
other objectives was the desire to serve 
certain types of clients, and to respond 
to the needs and interests of employers. 
Bamow believes that creaming is de- 
creasing with the increased use of state 
adjustment models for developing stan- 
dards, and with recent changes in both 
performance measures and adjustment 
models, and the dropping of cost stan- 
dards. 

But clearly there are questions re- 
maining. Bamow sees several worth 
policy attention; 

■ Whether the JTPA performance 
standards system promotes the maxi- 
mization of earnings and employ- 
ment gains and reductions in welfare 
transfers. 

■ Whether it achieves the goal of 
holding SDAs harmless for serving 
individuals with different character- 
istics. 

» Whether it should lead to indiffer- 
ence on the part of SDAs regarding 
the kinds of people served. 

Several sources of bias remain in the 
JTPA perfonnance standards adjust- 
ment models, Bamow says: 1) bias in- 
troduced by grouping data; 2) bias due 
to an incomplete set of explanatory 
variables, and 3) bias as a result of the 
focus on participants rather than on the 
eligible population. Some states have 
addressed equity issues by adding stan- 
dards for the participation of particular 
groups, others for outcomes for such 
groups. But Bamow reminds us that 
each new variable added to the models 
requires additional data collection, and 
as models become more complex they 
become more difficult to use. Con- 
sideration should be given, he says, to 
1) approaches that take into account 
important participant characteristics not 
included in the models, and to 2) avoid- 
ing basing reward/sanction systems 
solely on regression equations. 
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Performance Standards Systems 
in Other Programs 

The JTPA system for Title II is 
clearly tlie most highly developed. Title 
III uses only one standard, entered em- 
ployment rate, and an optional wage 
standard. Title IV progmms also have 
performance standards systems, as well 
as the Employment Service and the 
Food Stamp E&T Program. The JOB 
Corps includes standards for the perfor- 
mance of private sector center opera- 
tors, with sanctions involving the loss 
of a franchise. Standards are being de- 
veloped for the JOBS program as well. 
However, JOBS differs from JTPA in 
being a state rather than a local pro- 
gram, and in being jointly funded by 
federal and state governments, which 
affects the development of its perfor- 
mance management system. 

JOBS administrators have been con- 
cerned that standards may lead to 
creaming, and that the gross outcomes 
on which the standards rely are not 
highly correlated with net program im- 
pacts. But Bamow proposes that these 
concerns may be more reflective of a 
different service system philosophy 
than realistic anxiety about the influ- 
ence of performance standards. 

Bamow recommends that more data 
be collected on participants and their 
outcomes, that a rewards/sanction sys- 
tem be developed only gradually, and 
that administrators at the federal level 
resist basing performance standards on 
state-specific programs — he suggests 
that they wait for the results of a na- 
tional evaluation before setting stan- 
dards. 

Conclusions in Barnow’s 
Analysis 

At the end of his chapter there is an 
admonition to readers that none of the 
existing performance management sys- 
tems are perfect, or even ideal. But 
there is also optimism. The author is 
convinced we can develop reasonable 
systems that are useful. The basic ques- 
tion he poses is whether the risks of 
providing inappropriate incentives due 
to imperfect models “outweigh the ben- 



efits of providing program direction 
and accountability.” Performance man- 
agement systems offer our best chance, 
he believes, for dealing with conflicting 
program objectives, and for countering 
the tendency of bureaucracies to act in 
a manner inconsistent with the achieve- 
ment of economic efficiency. 

System Performance 

The trend in the mid-1990s is mov- 
ing inevitably in the direction of devel- 
oping performance measures and stan- 
dards for comprehensive workforce 
preparation systems at the state and lo- 
cal level. Can we apply Bamow’ s is- 
sues, cautions and recommendations to 
these systems? Undoubtedly. Tlie per- 
formance management concept Bamow 
defines fits the accountability needs of 
systems as well as programs. In this 
concept, performance measures and 
standards are to be based on goals, ob- 
jectives and a set of outcomes consis- 
tent with those goals. This is true for 
programs, true for systems of pro- 
grams. 

Most of the kinds of performance 
measures Bamow identifies as part of 
program-specific performance manage- 
ment systems are equally suited to sys- 
tem analysis. The exception is that 
since there is no “comparison group” 
for systems, net .mpact evaluations are 
not appropriate. However, cross-state 
comparisons may be possible, and net 
impact studies of consolidated pro- 
grams within the system may be useful. 
Longitudinal surveys that gather pro- 
cess and gross outcome information 
can also contribute to a knowledge of 
the system’s overall economic efficien- 
cy and effectiveness. 

Bamow’s exploration of issues in- 
volved in developing performance stan- 
dards, and his recommendation to col- 
lect an adequate database prior to such 
development, are important insights for 
the new coordinated workforce devel- 
opment systems. Although the author’s 
chapter does not address the role of 
evaluation research, per se, we turn our 
attention to that subject in the next arti- 
cle, i 



■ ■ 

Performance 
Management 
Systems: Evaluation 
Principles and 
Standards 

Analyses of performance manage- 
ment concepts and systems have fre- 
quently failed to address the role of 
evaluation research within these sys- 
tems. Sometimes evaluation is treated 
as an independent add-on oversight 
function, rather tlian an ongoing inte- 
gral element of performance manage- 
ment. Yet the professional stature and 
perceived utility of applied social re- 
search in producing valid information 
for “managing performance” in social 
programs has grown enormously over 
the past three decades. With the advent 
of larger-scale workforce development 
systems, the failure to define a viable 
role for evaluation research within per- 
formance management systems is an 
enigma of sorts, and represents a 
missed opportunity. 

This missing linkage is perhaps due 
most to the perception that evaluations 
are one-time, more expensive snap- 
shots of programs, and take a longer 
time than other strategies to yield use- 
ful results. There je even the view that 
the results of tho mure competent eval- 
uations are so well-qualified that they 
lose their utility. 

This perception ignores the role of 
process studies that look at ongoing 
program implementation processes, and 
longitudinal surveys which track cli- 
ents, services and results over time. 
They ignore the simple institution of 
formal feedback expectations and 
mechanisms within evaluation research 
contracts, which ensure that evaluation 
findings are immediately absorbed into 
policy and planning decisionmaking. 
They also ignore the basic need in all 
programs for genuinely accurate infor- 
mation, as opposed to information gen- 
erated from more subjective sources. In 
this respect, qualfications to evaluation 
research findings are required if what is 
learned about programs is to have any 
ring of validity about it. 
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Evaluation Research Goals, 
Principles and Standards 

One perspective on the role of eval- 
uation research is reflected in a 1994 
publication by Sage, The Program 
Evaluation Standards by James R. 
Sanders. Sanders is the chair of the 
American Evaluation Association’s 
Joint Committee for Educational Eval- 
uation. Although tlte book focuses sub- 
stantively on the education field, it is 
offered as a much more general contri- 
bution to the understanding of evalua- 
tion research, and is meant to apply 
equally well to social policies and pro- 
grams in other areas, such as employ- 
ment and training. 

The effort to develop principles and 
standards guiding evaluation research 
practice goes back to the early 1970s 
when twelve national professional as- 
sociations began to explore evaluation 
issues. These associations discovered, 
not to tlteir total surprise, that there 
were serious, fundamental difterences 
in their viewpoints. The Committee 
was formed to resolve such differences, 
which resulted in Standards for Evalu- 
ations of Educational Programs, 
Projects and Materials, published by 
McGraw-Hill in 1981. Through a pro- 
gressive series of meetings and the so- 
licitation of ideas from a large number 
of experts, the Committee later re- 
viewed and updated the 1981 effort, 
and reached a consensus on evaluation 
research principles and standards as of 
the 1990s, which are contained in the 
Sanders book. • 

The intent of this standards-setting 
process was to establish a professional 
guide for evaluation practice that 
would also educate evaluation custom- 
ers and the public about the role of 
evaluation research. The 1994 stan- 
dards represent the official position of 
the American Evaluation Association 
(AEA). 

But the Joint Committee is keen to 
remind readers and users that standard- 
setting is an ongoing process. Research 
practice and the professional knowl- 
edge base are constantly undergoing 
change, and such changes must be con- 
tinually reviewed and revised within an 



evolutionary process. The Committee 
also recognizes that the general princi- 
ples and standards of any era must re- 
main sensitive to the substantive fields 
in which they are being applied. And 
finally, the Committee sees evaluation 
standards as gKiV/ej, not as binding 
rules. 

The Evaluator’s Major Tasks 

The Committee believes that appli- 
cation of the standards must be judged 
in the context of key tasks evaluators 
perform: 

■ Deciding whether to evaluate. 

■ Defining the evaluation problem. 

■ Designing the evaluation. 

■ Collecting information. 

■ Analyzing information. 

» Reporting the ev aluation. 

B Budgeting the evaluation. 

» Contracting for the evaluation. 

B Managing the evaluation. 

B Staffing the evaluation. 

B Developing evaluation policies. 

The applicability and/or importance of 
a given standard, given these tasks, is 
considered to vary with the nature of a 
given evaluation. 

Evaluation Principles 

There are a number of ways to look 
at principles and standards. A 1992 re- 
port from the American Evaluation As- 
sociation’s Task Force on Guiding 
Principles for Evaluators gives us one 
viewpoint. The goals for evaluation 
that underly these principles are: 1) the 
improvement of “products, personnel, 
programs, organizations, governments, 
consumers, and the public’’; 2) more in- 
formed decisionmaking and more en- 
lightened change efforts; 3) the actual 
generation of change; 4) the empower- 
ment of stakeholders through engaging 
and investing them in the evaluation 
process; and 5) the incorporation of 
nevv insights irom research into public 
policy development, planning and 
oversight. 



The overriding purpose of evalua- 
tion is “to provide the best possible in- 
formation bearing on the value of what- 
ever is being evaluated.” This is in the 
context of Sanders’ definition of evalu- 
ation as “the systematic investigation of 
the worth or merit of a program.” Fig- 
ure 1 provides an overview of the Task 
Force's principles. Figure 2 is an over- 
view of the 1994 principles and stan- 
dards which are given more substance 
in Sander’s book. 

implications of the AEA’s 
PrincipSes and Standards 

Setting thresholds regarding the 
background and behavior of evaluators 
is much like setting performance stan- 
dards for programs. It clarifies roles 
and responsibilities. However, no in- 
centive^anction system accompanies 
the former, except the ability of cus- 
tomers to deny contracts to evaluators 
they do not feel fit the standards. This 
requires customers to be much better 
informed about the meaning and value 
of evaluation research than they are 
currently. These principles and stan- 
dards should assist customers in signifi- 
cant ways to be more sophisticated in 
developing RFPs for research, and for 
making sound selections among avail- 
able researchers for periodic process, 
outcome and net impact studies and for 
ongoing evaluation activities such as 
longitudinal surveys. 

The principles and standards also 
provide insights about the basis for 
quality assurance and continuous pro- 
gram improvement. As important goals 
of performance management systems, 
quality assurance and continous pro- 
gram improvement must necessarily 
depend on the nature of the information 
about programs, and their environ- 
ments, that is generated from a range of 
sources involving qualitative and 
quantitative information, objective and 
subjective data — through ongoing or 
periodic data collection and ana'”"‘s. 

The development of performan^.^ stan- 
dards is highly dependent on the quali- 
ty of this information. The AEA evalu- 
ation standards can, in that sense, make 
a significant contribution. 
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Systematic Inquiry 



Evaluators ar« expected to conduct systematic, data-based inquiries about wfiatever is being 
evaluated: 



Should adhere to the highest scientific stan- 
dards so as to increase information accuracy 
and credibility. 

Should communicate their approaches and 
methods accurately and honestly, and in suffi- 
cient detail to allow others to understand, inter- 
pret and CTitlque their work. 



Should clarify the values, assumptions, theo- 
ries, methods, results and analyses that signifi- 
cantly affect the interpretation of evaluation 
findings. 



Competence Evaluators are expected to assure stakeholders of competent performance: „ 

> Should possess the education, abilities, skills ■ Should decline to induct evaluations that fall 
and experience appropriate to the evaluation substantially outside those limits, 

tasks to be performed. b Should continually seek to maintain and Im- 

. Should practice within the limits of their profes- prove their competencies, 

sional training and competence. 



Integrity and Evaluators are expected to ensure the honesty and 

Honesty b Should negotiate honestly with clients and 

stakeholders concerning the costs, tasks, 
methodological limitations, scope of results 
and use of data resulting from an evaluation. 

■ Should seek to determine their own, their cli- 
ents’ and stakeholders’ interests concerning the 
conduct and outcomes of an evaluation. 

• Should disclose any roles or relationships they 
have concerning whatever is being evaluated 



integrity of the entire evaluation process: 
that might pose a significant conflict of interest 
with their role as evaluator. 

■ Should not misrepresent procedures, data or 
findings. 

a Should determine that if certain activities 
seem likely to produce misleading evaluative in 
formation or conclusions, these concerns are 
communicated to the customer. 



Respect for People 



Evaluators are expected to respect the security, dignity and self-worth of the respondents, pro- 
gram participants, clients and other stakeholders with whom they interact: 



Should abide by current professional ethics 
and standards regarding risks, harms, and bur- 
dens that might be engendered in those partici- 
pating In the evaluation regarding informed con- 
sent and informing participants about the scope 
and limits of confidentiality. 

Should conduct evaluations and communicate 
their results in a way that respects stakehold- 
ers* dignity and self- respect. 



Should attempt to foster the social equity of 
the evaluation, so that those who give to the 
evaluation can receive some benefits in return 
Should identify and respect differences 
among participants, such as In their culture, 
religion, gender, disability, age, sexual orienta- 
tion and ethnicity, and to be sensitive to the po 
tentlal implications of these differences when 
planning, conducting, analyzing and reporting 
on evaluations. 



Responsibilities 
Re: the General 
Public 



Evaluators are expected to articulate and take into account the diversity of interests and values 
that may be related to the general and public welfare: 



Should consider including in the planning and 
reporting of evaluations the perspectives and 
interests of the full range of stakeholders. 
Should consider not only the Immediate opera- 
tions and outcomes of the program being evalu- 
ated but also the broad assumptions. Implica- 
tions and side-effects of that program. 



Should allow all relevant stakeholders to have 
access to evaluative information, and actively 
disseminate it to them, tailoring this information 
to the interests of different stakeholders. 

Should maintain a balance between ciienl 
needs and other needs. 

Should protect the public interest and public 
good. 
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Uti9sty 



Evaluations should serve the information needs 

• The users and stakeholders, i.e., those Involved 
In and/or affected by evaluation activities, 
should be identified and their needs deter- 
mined. 

a Evaluators should be credible that Is. they 
should be both trustworthy and competent to 
perform evaluations, and so perceived by users 
and stakeholders. 

® The Information collected and analyzed should 
address key questions about organizations and/ 
or programs of Interest and concern to users 
and stakeholders. 

a The perspectives, processes and rationales un- 
derlying the Interpretation of evaluation findings 



of intended users and stakeholders. 

should be made explicit, so that the basis for 
judgment is clear. 

« Evaluation reports should clearly describe the 
program being evaluated: its context, its pur- 
poses, Its methodology, and the findings of the 
evaluation. 

o Significant interim findings and evaluation re- 
ports should be disseminated to users and 
stakeholders to encourage timely use of emerg- 
ing information. 

* Evaluations should be planned, conducted and 
reported in ways that promote follow-up by us- 
ers and stakeholders. 



Feasabiiity 



Propriety 



Accuracy 



Evaluations should be realistic, prudent, diplomatic and frugal. 



Evaluation processes should be practical, to re- 
duce disruption of the programs being evaluated. 
Evaluations should be planned and conducted 
with respect for the positions of various interest 
groups, to obtain their cooperation, and to reduce 



potential misapplication of evaluation findings. 
Evaluations should be efficient, and produce in- 
formation of sufficient value and use that the re 
sources expended on the research can be iusti 
fied. 



Evaluations should be conducted legally and ethically, considering tho welfare of those in 
volved In the evaluations and affected by the results. 

Evaluations should be designed to assist 



organizations and programs to address and 
effectively serve tho needs of all the partici- 
pants expected to benefit from organizational 
activities and tho receipt of program services. 
What Is to be accomplished, by whom, and 
when should bo agreed to in writing by the par- 
ties Involved in an evaluation, to commit them 
to the conditions of the agreement or to a for- 
mal renegotiation of the agreement if that be- 
comes important. 

Evaluations should be designed and conducted 
with a respect for the rights and welfare of the 



subjects of research actjv^ities. and the need to 
protect these values. 

Evaluations should recognize and record fully 
and fairly the strengths and weaknesses of 
the program being evaluated, so that problem 
areas can be addressed and strengths built 
upon. 

The formal parties involved In evaluations 
should make certain that the set of research 
findings and limitations to the findings are avail- 
able to those affected by the evaluation, and to 
any others with expressed legal rights to this in- 
formation. 



convey accurate (unbiased) information about the key features 
of the organizations or programs being evaluated. 

■ The organization or program being evaluated 



should be described clearly and precisely. 

The setting and environment of the program 
should be examined in sufficient detail to Identi- 
fy those factors most likely to affect the organi- 
zation or program. 

The adequacy of the sources of Information 
used In an evaluation should be determined. 
Data collection methods should be selected and 
applied such that reliable and valid information 
is the basis for Interpretations of the findings. 
The research design (experimental or nonex- 
perlmental) Including methodological decisions 
(about measurement, sampling methods, and 
quantitative and qualitative data collection and 



analysis methods) that guide evaluations 
should be appropriate to the research questions 
selected for study. 

The evaluation process should be monitored 
and assessed throughout the evaluation. 

The conclusions flowing from an evaluation 
should be made explicit and should be justified; 
and evaluation reports should honestly reflect 
the results of the evaluation and any qualifica- 
tions to its findings. 

The strengths and weaknesses of the evalua- 
tion design, methodology, and research pro- 
cess should be assessed at the completion of a 
study. 
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For useful references on evaluation 
research, please see: 



Alin, M. at al. Using Evaluation: Does 
Evaluation Make a Difference? New- 
bury Park, CA: Sage Publications, 
1979. 

Cook, T. and C. Reichardt (eds.) Quali- 
tative and Quantitative Methixls In 
Evaluation Research. Newbury Park, 
CA: Sage Publications, 1979. 

Herman, J. Program Evaluation Kit. 
Nina volumes on different aspects of 
ev^uation research. Thousand 
Oaks, CA: Sage Publications, 1987. 

Levin, H. Cost-Effectiveness: A Primer. 
Thousand Oaks, CA: Sago Publica- 
tions, 1983. 



^dltoriai Cp'rn'^ ^ ' 



This series of artidas yields common 
elements of performance management 
systems forjudging programs, and 
groups of related programs in work- 
force development systems. Quality as- 
surance, continuous program improve- 
ment, performance measures and 
standards, and evaiuatior* research are 
key concepts. 

Contrary to some of the distinctions 
made by the authors represented in this 
section, it would seem logical to view 
perfomiance management (or account- 
ability) systems as the holistic concept , 
and attribute to these systems a num- 
ber of goals; 



Mohr, L Impact Analysis for Program 
Evaluation. Thousand Oaks, CA; 
Sage Publications, 1992. 

Patton, M. Qualitative Evaluation and 
Research Methods. Newbury Park, 
CA: Sage Publications, 1990. 

Utilization-Focused Evaluation. 

Beverly Hills, CA; Sage Publications, 
1986. 

Rossi, P. and H. Freeman. Evaluation: 
A Systematic Approach. Thousand 
Oaks, CA: Sage Publications, 1991. 

Shadish, W. et al. Foundations of Pro- 
gram Evaluation: Theories of Prac- 
tice. Newbury Park, CA: Sage Publi- 
cations, 1991. 

Strauss, A. Qualitative Analysis for So- 
cial Scientists. New York, NY: Cam- 
bridge University Press, 1987. 



■ To assure high quality throughout 
the various aspects of individual pro- 
grams and systems of programs. 

• To make assessments of systems 
and programs using performance 
measures and standards. 

m To evaluate systems and programs 
regarding dimensiot^s of their opera- 
tion, the characteristics of their client 
groups, the nature of their services 
and service delivery systems, their 
outcomes for partidpants and others 
expected to benefit from thorn, and 
their net impacts. 

■ To continuously improve systems 
and programs through the timely use 



Stufflebeam, D. Metaevaluation. 

Kalamazoo, Ml: The Evaluation Cen- 
ter, Western Michigan University, 
1988. 

Worthen, B. and K. White. Evaluating 
Educational and Social Programs: 
Guidelines for Proposal Review, On- 
Site Evaluation, Evaluation Con- 
tracts, and Technical Assistance. 
Boston, MA: Kluwer Academic Pub- 
lishers, 1987. 

Three useful journals are Evaluation 
and Program Planning, New Directioris 
for Program Evaluation, and Evaluation 
Practice. 



of objective evaluative information 

from various sources. 

The inclusion of quality assurance, .. 
continual program improvement, perfor- 
mance standards and evaluation re- 
search within the concept of perfor- 
mance management recognizes that a 
range of strategies for judging systems 
and programs are, and must be, en- 
compassed in the effective manage- 
ment of programs — if indeed the pur- 
pose of accountability systems and the 
goals of management are to maintain a 
satisfactory level of performance or en- 
hance it. None of these strategies 
should be cordoned off in a territory of 
its own. 
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At the State and Local Level 
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The Interest in program coordination 
and sorvksa system integration is not 
new. It even appears to be politically 
cyclical. In the 1950$ many communi- 
ties created local social service coun- 
cils which brought program organiza- 
tions together around common 
community goals. The missing link was 
a commitrnent to strategic planning In 
the format sens©, and to oversight ac- 
tlvitias such as monitoring compliance 
with formal plans and judging overall 
performance, 

in the 1070s there was another 
wave of coordination eliorts, under the 
title “human services Integration." This 
was the era of the federal Joint Funding 
Simplification Act, which offered a strat- 
egy for packaging federal funds for bet- 
ter coordinated, even though not yet In- 
tegrated, human service activities. Most 
of the 1970 concepts remained policy 
goals that were only sparsely tested 
and implemented, and continuing Inter- 
est group pressures yielded an increas- 
ingly fragmented social service and 
workforce preparation system. 

The Reagan Administration advocat- 
ed what appeared to be a now version 
of coordination through biock grants to 
states. The consolidation of funding 
streams was viewed by some experts 
as the only way to achieve true integra- 
tion of existing program territories. But 
the goal at this time was only second- 
arily to puli social programs together 
more erfectively. It was mainly a way to 
satisfy political commitments to states’ 
rights and to cut the federal budget, 
since the down side of these block 
grants was increased state responsibili- 
ty coupled with reduced funding. 

The Clinton Administration acknowl- 
edged that multiple program organiza- 
tions had now developed a natural re- 
sistance to integration. Separate 
funding streams for programs and 
projects understandably reinforced the 
bureaucratization of those organization- 
al empires. Concern about the impact 
of this development on costs, and on 
the results of service efforts on custom- 
ers, led to another coordination move- 
ment In the 1990s. 

The reforms characteristic of the 
present movement have continued to 
preclude the comingling of program 
funds and the actual consolidation of 



pr<^rams. But the changes recom- 
mended go signifioantly further than 
earlier concepts In knitting diverse edu- 
cational, training and employment ef- 
forts Into a single “system,* particularly 
at the state level — with strong man- 
dates regarding short and longer-term 
strategic planning and th® use of a 
common set of measures for monitoring 
and evaluating the progress of the sys- 
tem In meeting planning expectations. 
Secretary Relr^’s Reemployment Act of 
1994 was an Important expression of 
the now philosophy. 

Therefore, as a prelude to this series 
of articles on earlier and contemporary 
coordination efforts, we summarize the 
major features of the Act in the list be- 
low. 

s The establishment of state human 
■ resource Investment councils or their 
equivalent. These councils are to be 
responsible for developing a com- 
prehensive state-wide workforce de- 
velopment plan and system, and for 
overseeing the implementation of 
this plan and th© system’s perfor- 
mance. 

B The identification of substate one- 
stop service areas. 

0 The development of a common opera- 
tional agreement among ail the parties 
Involved in the one-stop centers. 

• The creation of local workforce in- 
vestment boards within the one-stop 
center areas. 

Composition: 

♦ Representatives of private sector 
employers. Private sector em- 
ployers are to be a majority on 
these boards. 

♦ Representatives of organized la- 
bor and community-based organi- 
zations. 

♦ Representatives of educational 
institutions. 

♦ Community leaders. 

Functions: 

♦ Provision of policy guidance. 

♦ Development of a strategic plan for 
workforce development programs 
consistent with the state plan. 

♦ Identification of measurable ob- 
jectives for improving the quality 
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and effectiveness of v/orkforce 
development. 

* Utilization of labor market and re- 
lated Information to identify avail- 
able jobs and occupations In de- 
mand, and ttie educational and 
training services available to de- 
velop skills. 

♦ Development of methods for co- 
ordinating programs so that they 
provide maidmum coverage of 
the workforce, ensure equitable 
access to all population sub- 
groups, and enhance th© delivery 
of services. 

0 Review and approval of budgets 
for federal programs, and the de- 
velopment of recommendations 
regarding the budgets of other 
programs operating within the 
one-stop service areas. 

<» Monitoring of the Implementation 
of the strategic plan and the Judg- 
ment of the overall performance 
of th® local workforce preparation 
system. 

■ The establishment of one-stop ca- 
reer centers. 

■ The provision of a menu of common 
services through the centers. 

o The participation of federal employ- 
ment and training programs in the 
centers. 

■ The development of u quality assur- 
ance and performance management 
system. 

The following series of articles is In- 
tended to shed some light on the histo- 
ry of coordination, and on current ef- 
forts to pull an unwieldy duster of 
consdentlously-designed educational, 
training and employment efforts togeth- 
er Into a more comprehensive, coher- 
ent, market-driven, user-oriented sys- 
tem. 

The first article looks at some of the 
history of coordination The second fo- 
cuses on the efforts of some states to 
coordinate their employment and train- 
ing programs within state-wide sys- 
tems. The third and fourth review Im- 
portant conceptual and pragmatic 
reports supporting state coordination 
efforts. The last explores NQA’s project 
to enhance accountability in new state 
workforce development systems. 
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A Brief, Selected 
History of 
Coordination 
Efforts 

Tied as we tend to be to our own era 
in employment and training, we often 
assume ttat the initiatives, or “re- 
forms,” indigenous to the life or our 
own careers must be new and different. 
Within this perspective these reforms 
hold our attention and energize us to 
experiment with and adapt useful ideas 
to the needs of our time. But it is also 
important for us to understand and 
learn from the history that precedes 
“our time.” 

A report yet in draft form at the time 
this article was written is a unique re- 
source in this respect. It is the National 
Commission for Employment Policy’s 
monograph tentatively titled “Histori- 
cal Efforts to Improve Coordination in 
Employment and Training Programs” 
and is authored by the Commission’s 
acting director, Janet Johnston. This 
excellent in-progress report tells us 
much we need to know. 

What I* The Problem? 

The report raises the issue of the 
U.S. General Accounting Office’s se- 
ries of 1994 reports on problems asso- 
ciated with the proliferation of employ- 
ment and training programs, titled 
Multiple Employment Programs. This 
series clarifies that there are now over 
150 programs devoted to workforce 
preparation, administered by 15 agen- 
cies, and funded at approximately 25 
billion dollars. The Commission itself 
completed a comprehensive inventory 
in 1994 of 55 federally-flmded employ- 
ment and training programs adminis- 
tered by 7 agencies. Understanding 
Federal Training and Employment 
Program, which includes information 
on who sponsors and funds them, 
whom they serve, how many are 
served, their funding levels, and infor- 
mation from research on their efficien- 
cy and effectiveness. The array is 
mind-boggling. 

What la The Recent Reaponse? 

In response to earlier concerns about 
program and service coordination, the 



Clinton Administration recommended a 
consolidation of six programs for dislo- 
cated workers under a new governance 
arrangement, with coordinated services 
delivered through one-stop multi-ser- 
vice centers at the local level. Over- 
sight would be the responsibility of lo- 
cal workforce boards under the 
guidance of state Human Resource In- 
vestment Councils or their look-alikes. 

In the winter of 1994/1995, the new 
Congressional leadership suggested 
other alternatives, including a 1990s’ 
consideration of the block grant con- 
cept which surfaced earlier in the Nix- 
on and Reagan years. 

The Commleslon’s Perspective 
on the History of Coordin. tion 

Johnston sees the evolution of na- 
tional employment and training initia- 
tives between the Great Depression and 
the 1990s as federal experiments that 
“evolved from a collage of individual 
contracts and grants administered by a 
number of federal agencies to broaden 
programs aimed at specific target 
groups.” The major question this evolu- 
tion raises for the auAor is what the 
role of the federal government should 
be vis-a-vis state and local government 
bodies. 

This question leads Johnston to ana- 
lyze the history of coordination within 
four issue areas: comprehensive plan- 
ning, coordinated service delivery, ad- 
ministration and fund consolidation. 

Comprehensive Planning 

The 1967 Cooperative Area Man- 
power Planning System was the prod- 
uct of four federal agencies working to- 
gether on what Johnston views as a 
grass roots-upward coordinated plan- 
ning concept. This system was a way to 
enclose coordinated planning and re- 
source allocation within an integrated 
intergovernmental system linking local 
communities with different levels of 
govermnent. But the system was volun- 
tary, the different governmental levels 
disagreed over control issues, policies 
were not sufficiently supported by 
more specific objectives and implemen- 
tation strategies, arid the results were 
not carefully evaluated. Consequently 
the system did not live up to expecta- 
tions, Johnston concludes. 



Coordinated Delivery Systems 

A number of strategies in the 1960s 
held promise for integrating services. 
However, planning inflexibilities and 
unrealistic goals reduced their effec- 
tiveness, according to Johnston. In 
1972, the Comprehensive Manpower 
Program was introduced. It consisted 
of a series of demonstration projects 
testing the coordination of services 
across political jiuisdictions and was 
constructed on earlier coordination ef- 
forts. But service contracting remained 
fragmented, and establishing linkages 
among existing programs proved to be 
difficult. However, a revision of the 
program appeared to be superior to pre- 
vious attempts in terms of the decen- 
tralization and decategorization de- 
sired, short of new comprehensive 
employment and training legislation. 

Administrative Solutions 

Although administrative reforms 
were less attractive and dramatic to 
planners than comprehensive planning 
and service delivery coordination, Nix- 
on’s A-95 process was expected to de- 
centralize programs, simplify federal 
grant processes, standardize administra- 
tive rules, and integrate the administra- 
tion of grants to state and local govern- 
ments — thereby providing a new 
environment for coordination. This 
change did streamline grantmaking and 
monitoring systems, and promoted 
comprehensive program management. 

Fund Consolidation 

In 197 1 , the federal government in- 
troduced Planned Variations, an exper- 
iment to give mayors more discretion 
in spending federal grants. The test 
yielded mixed results in terms of the 
power, sophistication and effectiveness 
of mayors in utilizing this flexibility. 
Meanwhile, Nixon’s revenue sharing 
was to replace cat'^gorical programs in 
several broad issue areas — education 
and employment/'u-aining being two of 
these — and gave grant recipients even 
greater discretion in spending funds. In 
the process, it was to allow for a con- 
solidation of programs at the subna- 
tional level, consistent with the priori- 
ties of state and local governments. But 
the Congress became concerned about 
the lack of monitoring and evaluation 
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of the efforts made, and the idea of rev- 
enue sharing faded away like an old 
soldier. 

Another Perspective on 
Coordination 

The Commission draft report chroni- 
cles the important, if imperfect, coordi- 
nation efforts through the 1990s. But 
before venturing past the 1970s, we 
should reminisce a moment about the 
larger human services integration 
movement of the late 1970s. We can 
catch a glimpse of this movement quite 
well in a large green tome used exten- 
sively in social welfare courses in that 
era, titled Managing Human Services, 

It was published in 1977 by the Insti- 
tute for Training in Municipal Admin- 
istration and the International City 
Managers Association. Its editors were 
an eclectic group: Wayne Anderson 
from the U.S. Advisory Commision on 
Intergovernmental Relations, Bernard 
Frieden of MIT, and Michael Murphy 
of the Management Association. 

The book summarized, analyzed and 
commented upon a considerable body 
of managerial knowledge and experi- 
ence regarding human service policy 
development, delivery and evaluation. 
The content was focused on the chang- 
ing roles of different levels of govern- 
ment in assessing a range of human ser- 
vice needs, developing human service 
policies and the delivery of such servic-^ 
es, evaluating tlieir results, and using 
this information to improve policies 
and their implementation. Sound famil- 
iar? 

The last chapter of the book honed 
in on service integration. Authored by 
Robert Agranoff, a political science 
professor, director of the Center for 
Governmental Studies at Northern Illi- 
nois University, and chair of the Amer- 
ican Society for Public Administra- 
tion’s section on Human Resources 
Administration, the chapter gives us an 
impressive overview and commentary 
about the thinking of that era regarding 
coordination, AgranolT defined service 
integration as a veritable movement. 

The belief expressed in that movement 
was that the most useful way to address 
people’s needs W'as an holistic one — 
that is, services should be based on the 
needs of entire government systems, 



and the entire set of a client’s needs, 
rather than on a single problem, on 
pressures from a single advocacy 
group, or on a single categorical agen- 
cy. 

The author suggested that human 
services integration be defined in terms 
of: 

m A comprehensive policy that cuts 
across independent programs and 
classes of services. 

• A service delivery system designed 
to meet the needs of clients whose 
problems go beyond a single prob- 
lem, program or agency. 

■ A consolidated organizational struc- 
ture that supports the above con- 
cepts. 

The problem stimulating serious 
thinking about integration, Agranoff 
said, was 1) the expansion of categori- 
cal human service programs; 2) the 
multi-faceted role of government (per- 
forming funding, regulation, purchase 
of services, and ether functions in addi- 
tion to service delivery); 3) generic 
problems in service delivery (fragmen- 
tation, discontinuity, inaccessability 
and unaccountability); 4) whether ser- 
vice strategies are meeting their goals; 
and 5) the lack of policies seeking to 
resolve these problems. 

The author proceeded to provide an 
overview of federal human service inte- 
gration initiatives such as the Commu- 
nity Action Agencies, Model Cities, fed- 
eral research and demonstration 
projects such as the Services Integra- 
tion Targets for Opportunity program, 
the U.S. Department of Health, Educa- 
tion and Welfare’s Partnership Grants 
program, and state and county efforts 
initiated with or without federal assis- 
tance such as the Flexible Intergovern- 
mental Grant project in the northwest. 
These efforts were more extensive than 
we might have imagined. 

The concept of a service delivery 
model serving the v^hole individual 
with multiple needs actually surpasses 
current integration initiatives. It was 
not tied to categories of need, such as 
to education, training and employment, 
but broadened to include diverse ser- 
vices, income assistance, and personal 



counseling. Agranoff called this a ^bot- 
toms-up planning approach.” Rather 
than relying on the functions of agen- 
cies in bringing things together, the 
planner organizes a service system 
around sets of client needs. Although 
the imperative for coordination at the 
federal, state and county levels was ad- 
dressed, the emphasis was on a local- 
level ‘‘human services subsystem”, 
which was to operate much like a com- 
munity development or land use sub- 
system. Within tliis perspective, naUiral 
linkages were seen to exist between the 
subsystem and a myriad of resources 
within the entire community. 

But Agranoff was not naive about 
the ability of governments and commu- 
nities to implement this concept. He ac- 
knowledged the weak supports for 
moving in this direction. Yet this 
movement was receiving momentum 
from important people. Frank Carlucci, 
a former Undersecretary of Health and 
Human Services, testified before the 
Congress in support of this holistic ap- 
proach. Social welfare experts such as 
Alfred Kahn of Columbia University 
suggested a very simple service net- 
work: “an access system, or numerous 
neighborhood information centers 
charged with giving people information 
and options, and allowing for selection 
and monitoring; generalist social ser- 
vice offices that would offer general 
counseling and manage the case if spe- 
cialized services are needed; and spe- 
cialized programs.” 

This human services integration 
movement clearly has much to offer in 
the current debate over how to coordi- 
nate policy, planning, service delivery 
and oversight in large areas of human 
services. 

More Recent History 

For obvious contemporary cultural 
reasons, “manpower planning” became 
employment and training or workforce 
system planning in the 1980s and 
1990s. Such planning had benefited 
from the lessons learned in previous at- 
tempts to cooperate, collaborate, coor- 
dinate, integrate and consolidate. But 
territoriality continued to pose chal- 
lenges. We return to Janet Johnston’s 
insightful analysis. 
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The State Job Training Coordinating 
Councils and more localized Private In- 
dustry Councils in JTPA revised the 
notion of decentralized comprehensive 
planning in the direction of privatiza- 
tion. Based on a Commission study of 
the PICs, Jolmston suggests that their 
main weakness has been a lack of train- 
ing in planning and oversight for 
chairs, boards and council staff. 

Secretary Reich’s Reemployment 
Act took the council idea a step further 
in recommending the formation not 
only of statewide and regional councils 
but also local boards that could oversee 
one-stop multi-service centers. Strate- 
gic planning, budgeting and oversight 
were to be the cornerstone functions of 
these new mechanisms for coordina- 
tion. Again, experimentation with tliese 
innovations have encountered substan- 
tial territoriality. 

Johnston points out tliat the JTPA 
amendments gave governors the option 
of developing Human Resource Invest- 
ment Councils as a way to expand the 
stakeholder group and service cover- 
age. The Reemployment Act requires 
this. Currently there are variations on 
the theme. Eighteen states have formed 
councils of the kind recommended in 
the act. Some have established even 
broader-based bodies. But other state 
councils have involved fewer constitu- 
encies than mandated in the act. Many 
are moving in this direction but have 
not yet arrived. 

Since there are no sanctions current- 
ly for failing to create comprehensive 
state and local workforce system 
boards or councils, and limited rewards 
for doing so, states have made uneven 
efforts, their coordinating bodies differ- 
ing regarding leadership, composition, 
priorities, policies and implementation 
strategies. Bringing prcviously-sover- 
eign organizational entities together 
around common goals, linking these 
entities with employers and unions and 
related stakeholders, has not been easy. 
The mixed results of efforts to coordi- 
nate JTPA and JOBS, whose client 
populations overlap, is an example of 
the difficulties. 

Another illustration is pinned down 
in the results of a Commission-funded 
survey conducted by the National Alli- 
ance of Business in 1985, which indi- 



cated that close to 30% of all Private 
Industrj' Councils felt state councils 
had no impact on their activities or had 
actually created problems for them. Yet 
states have been innovative in the way 
they have established councils in terms 
of their sensitivity to existing organiza- 
tional arrangements across workforce 
programs and institutions. Some have 
incorporated the state job training 
council, as in Oregon. Some have fold- 
ed in the State Council on Vocational 
Education, as in New Jersey. Some 
have “umbrella councils” whose func- 
tions are limited to high-level policy 
development, long-term planning and 
oversight, as in New York. Meanwhile, 
Indiana exemplifies the kind of council 
recommended by the Reemployment 
Act. 

And there are instances of states 
braving the waters relatively alone. 
Johnston reports that the MASS Jobs 
Council has developed strong regional 
employment and training boards by 
providing genuine financial incentives 
for their functioning as regional plan- 
ning bodies, for their devising methods 
for measuring the board’s effective- 
ness, for their developing an expanded 
labor market and service information 
system, and for their having linked the 
boards with economic development ef- 
forts. 

Information System Technology 

In this age of information systems, 
we reluctantly recognize that manage- 
ment information systems often drive 
service integration, or at least support 
its development. There is increased in- 
terest in automating information for 
customer use in one-stop centers — 
both information about the labor mar- 
ket and information about service op- 
tions, across organizations. And there 
is a fluorescence of interest in comput- 
erizing more sophisticated and useful 
monitoring and evaluation information 
across these territories — high-tech in- 
formation systems now considered a 
key element in coordination efforts. 
Few states have such systems in place, 
but many are moving in tliis direction 
despite difficulties in developing com- 
mon operational definitions and mea- 
sures for key variables across pro- 
grams. States such as New York and 
Wisconsin have gone far to pull infor- 



mation networks together, and a num- 
ber of other states have developed a 
core set of measures common to all 
programs within state workforce devel- 
opment systems. 

Consolidation at the 
National Level 

It is interesting that despite the ma- 
jor efforts being made at the state level 
to carry out ever-stronger decentraliza- 
tion and privatization mandates regard- 
ing coordination, there is also a bub- 
bling-up of support for a national 
woriforce development council or 
board. The State Job Training Coordi- 
nating Council Chairs’ Association, in 
their monograph Bringing Down the 
Barriers t has recommended the estab- 
lishment of a Federal Human Resource 
es Investment Board by Presidential ex- 
ecutive order. This mirrors the role of 
the National Commission, raising the 
possibility of expanding the Commis- 
sion’s composition and responsibilities, 
as a more inclusive vehicle for nation- 
al-level policy development, compre- 
hensive planning and oversight. 

Adding ideas to the hopper is the 
prestigious National Research Council, 
through its Committee on Postsecond- 
ary Education and Training for the 
Workplace, The Committee’s recent 
two-year study of workforce system in- 
novations, funded by the U.S. Depart- 
ment of Education, concluded that a 
new independent OJfice ofWorIrforce 
Development be created, much like the 
National Science Foundation. This of- 
fice would apparently absorb some of 
the functions now performed by other 
federal agencies. Given the current 
trend toward reduced federal govern- 
ment, this careful study was quite im- 
portant in confirming the continuing 
need for strategic planning and over- 
sight at the federal level. If we believe 
that cooperation and coordination 
among diverse parties is an essential 
characteristic of American social de- 
mocracy, there is hope. However, given 
Congressional leadership sentiments, a 
coherent national workforce develop- 
ment effort may or may not be viewed 
as an essential part of unrelenting ef- 
forts over time to bring greater integra- 
tion and rationality to workforce prepa- 
ration. 
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Establishing 

Comprehensive 

Workforce 

Development 

Systems: 

State-Level Efforts 
in the 1990s 

There has been a gradual recogni- 
tion over time that what the federal 
government and state governments 
across the country wished could be de- 
scribed as a nicely integrated set of ed- 
ucational, training and employment ser- 
vices for American workers was, in 
fact, a patchwork of separate service 
programs, however well-conceived and 
designed as separate initiatives. The de- 
velopmental history of each major na- 
tional program, and a myriad of smaller 
state efforts, had resulted naturally in 
diverse policies and planning priorities, 
organizational structures, service deliv- 
ery procedures and practices, ways to 
monitor what was happening within the 
program and its results, and methods 
for assessing the effect of influences 
imbedded in program environments. So 
concern about and enthusiam for find- 
ing solutions to the lack of coordinaton 
has been building. 

The President, the Congress and the 
federal agencies began to take the coor- 
dination problem more seriously begin- 
ning in the late 1980s, with JTPA, 

JOBS and vocational education. A 
number of studies of coordination were 
conducted to determine **best coordi- 
nation practices , " At the same time, 
there was an increased interest in social 
program accountability. There were 
many reasons for this, among them 
public anxiety about Ae economy, gov- 
ernment deficits, and the proliferation 
of programs ahead of their evaluation. 

This “accountability movement” 
was occurring at all levels of govern- 
ment, as well as in the private sector. 
Evaluation researchers were brought 
into this debate and the search for solu- 
tions because of the growing prestige 
of applied research and the perception 
that utilizing social science principles 



and methods could guide the produc- 
tion of objective information for policy 
and planning most effectively. 

States benefited from federal coordi- 
nation efforts. Closer to the pressures 
for change, however, they were devel- 
oping their own strategies. Having al- 
ready taken the initiative, many states 
were furtlier energized by the Clinton 
Administration’s coordination priori- 
ties and legislative proposals in support 
of workforce development systems. 
These priorities placed emphasis on 
emerging state-level efforts to develop 
comprehensive state-wide workforce 
preparation systems that were bringing 
together individual programs and ser- 
vices under one policy and planning 
roof, and making the system’s services 
accessible through coordinated multi- 
service centers. Paralleling this boost to 
coordination were efforts to address ac- 
countability issues in judging the per- 
formance of these new entities. Now 
the focus was on the outcomes and im- 
pacts of systems of programs. 

This article provides a selective 
overview of state efforts in 1994 to ad- 
dress accountability issues in new state- 
wide workforce preparation systems. It 
is skewed toward states’ beginning 
conceptual efforts, which have likely 
undergone considerable revision since 
originally conceived. 

Characteristics of Selected 
State Workforce Systems 

Based o.} materials provided by ap- 
proximately nine states concerning 
their state-wide workforce system’s 
missions and goals, the following at- 
tributes were identified: 

■ Most of the states were integrating 
education, job training, employment, 
income support, related supportive 
services, and economic development 
efforts. 

■ Most were assigning planning, coor- 
dination and oversight responsibili- 
ties for the entire workforce system 
to a single central body — a state- 
wide council or board. 

■ About half of the states were involv- 
ing business and labor to a high de- 
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gree in system planning and over- 
sight. 

■ Nearly all were placing heavy stress 
on strategic planning and a review 
of results against plans, across the 
entire workforce development sys- 
tem. 

o Most were developing linkages 
across programs tlirough local work- 
force boards, local planning, and 
one-stop centers for integrated ser- 
vice delivery. 

■ The majority were working toward a 
common core set of data elements 
and definitions, and a uniform set of 
perfonnance measures and standards 
that were to apply to all workforce 
development programs. 

o Most had not chosen to develop in- 
centive/sanction systems related to 
performance. 

m About half were giving serious 
consideration to achieving consis- 
tency between system goals, skills 
standards, certification systems and 
accountability methods. 

■ A slight majority was committed to 
integrating data systems across the 
workforce system, with the others 
moving toward coordinated or 
linked data systems. 

« The vast majority were requiring 
that the system’s programs be made 
accountable through multiple strate- 
gies, including evaluation research. 
There was substantial interest in 
both process and outcome evalua- 
tion, and net impact studies — Le., 
a formal evaluation system. 

■ Few states had developed strategies 
for disseminating and utilizing eval- 
uative information for continually 
improving the system. 

Common Features of State 
Workforce Development 
Systems 

A prevailing characteristic of these 

comprehensive systems was that they 
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^had moved toward a market and 
-^cusiomer-^driven approach, away from 
traditional program-driven approaches. 
This involved the private sector in new 
ways* particularly in strategic plan-- 
nihg, coordination and oversight — 
and in the design of skills and certifica- 
tion systems, as well as labor market 
information systems. 

It was a new era also in the emphasis 
states were placing on performance 
management systems oriented to out- 
come measurement and the develop- 
ment of performance standards. In this 
sense, states were adopting federal 
models and tailoring them to their cir- 
cumstances and needs. The stress on 
performance supported a greater inter- 
est in going beyond monitoring and re- 
porting, and the review of results 
against strategic plans, to a commit- 
ment to evaluating the efficiency and 
effectiveness of programs within the 
workforce system, and of the system it- 
self. 

Few states had formal evaluation 
plans, but some had targeted funding 
for evaluation, had created advisory 
committees for that purpose, and had 
developed professional evaluation 
strategies. Some had required consis- 
tency across system goals, measurable 
objectives, certification system expec- 
tations, and performance measures, 
linking these elements within on ac- 
countability system. 

Nearly all the states reviewed had 
been interested in pulling their data 
systems together more effectively to 
support expanded oversight interests 
and commitments. Some were integrat- 
ing existing systems into a single imi- 
fied data system with common defini- 
tions and measures of key program 
elements. Some were developing new 
data linkages across existing systems. 
Some were creating cross-walks be- 
tween established MlSs and data dic- 
tionaries. Some had expectations for lo- 
cal-level data integration which would 
link state and local systems. 

In all cases, a first step had been to 
reach a consensus on a common set of 
data elements describing desired out- 
comes for the entire system, with some 



states extending this effort to program 
implementation variables, and to a de- 
scription of services as well as client 
characteristics. A few states were at- 
tempting to develop a single automated 
service delivery “front-end” for intake, 
client assessment and case manage- 
ment Most had been developing ex- 
panded and more integrated labor mar- 
ket information systems to support 
policy development and service deliv- 
ery as well as monitoring and evalua- 
tion. 

In most states, outcome measure- 
ment and performance standards devel- 
opment focused on a common set of 
outcome variables: completion of edu- 
cation or training; acquisition of certi- 
fied skills; continuation of education or 
training; placement in employment (by 
occupation, industry and relationship to 
the training received); earnings in em- 
ployment, job retention and cost per 
positive outcome. 

Some states had given attention to 
the economic development side of 
workforce development: job creation, 
incentives for employers to retrain and 
retain workers, incentives for employ- 
ers to remain in the state, and entrepre- 
neurial projects emphasizing the devel- 
opment of high performance work- 
places. 

Some Unique State Approaches 

Despite important common elements 
across state-wide workforce systems, 
each state had customized its approach 
— to its own environment, needs, inter- 
ests and resources. Michigan, for exam- 
ple, had classified outcomes according 
to whether they served customers or ad- 
ministrators. The state proposed com- 
mon fonns and procedures, the devel- 
opmen^ of common management 
standards, and die creation of inte- 
grated local MISs. 

New York's annual strategic plans 
required an evaluation component. 
Oregon was interested in technical as- 
sistance and training for personnel car- 
rying out accountability tasks, and in 
common standards for the design of in- 
formation systems. The state estab- 
lished a formal Performance Measure- 
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ment Initiative to promote the produc- 
tion of information on efficiency and 
effectiveness, replete with a single 
“performance index” for each program. 
Florida attached the development of 
“industrial incubator partnerships” to 
its workforce system, promoting inno- 
vation within the system and creating a 
new area for evaluation. 

Texas applied sunset rules to pro- 
grams within the workforce system, re- 
quiring systematic evaluation. Provid- 
ers had to document the market demand 
for services, and there were incentives 
for “best practices” based on evalua- 
tions. The state targeted money specifi- 
cally for performance management and 
evaluation, and the training of profes- 
sional personnel needed for those func- 
tions. It also created a formal Evalua- 
tion and Performance Committee. 

North Carolina planned to seek pri- 
vate sector funding for evaluation ac- 
tivities, Iowa was pursuing an interest- 
ing, useful chronolo^ of steps in 
integrating the workforce system’s in- 
formation system, by beginning with 
structured interviews and focus groups 
with providers and stakeholders which 
contributed insights to the IBM design 
consultants. The design was then im- 
plemented in several phases that built 
on the state’s existing MIS investments 
and allowed key operational and pro- 
gram issues to be resolved as technical 
computer environments were created. 

The Great Lakes Guarantee, which 
sought to weld together into one coher- 
ent system the accountability efforts of 
several states within a regional labor 
market, existed at the high end of the 
accountability continuum in proposing 
the most integrated and comprehensive 
approach to information production for 
policy development and strategic plan- 
ning. 

The combination of common ele- 
ments and state-specific strategies 
sketched above reveals the growing 
emphasis on accepting more uniform 
principles within and across states for 
guiding the integration, consolidation 
and/or coordination of more inclusive 
workforce development systems, while 
at tine same time preserving discretion 
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and flexibility in the way these princi- 
ples were applied. 

The Implications of State-Level 
System Development 

The renewed interest in 1995 in 
block grant approaches, and a further 
devolution of federal monies to states 
and local areas, will require — if im- 
plemented — very serious and careful 
strategic planning and coordination by 
state governments, and stronger public- 
private partnerships at that level. The 
experience of those states that have 
moved rapidly on federal coordination 
initiatives, such as state-wide work- 
force system development, should be in 
a far safer position than before to cope 
with expanded decentralization and the 
responsibilities that accompany it. 



Contemporary 
Coordination Efforts: 
The Core Data 
Elements Project 

In the late 1970s and in the 1980s, a 
number of states had seen the need for 
^eater organizational and service de- 
livery integration across the many 
agencies and programs assisting indi- 
viduals in acquiring education, occupa- 
tional skills and sustaining employ- 
ment. The federal government’s 
anxiety about coordination seemed re- 
newed as well. This was not unexpect- 
ed. The public, and therefore the Con- 
gress, was concerned about the 
growing proliferation and fragmenta- 
tion of education, training and employ- 
ment programs with its attendant costs, 
and about the preoccupation with pro- 
gram inputs to the neglect of outcomes. 

In response to these concerns a 
“second wave” of interest in human 
services integration occurred in the 
1990s. Much of the force behind the 
second wave was a desire to reduce 
government expenses. Influential also 
was the perceived need to reduce ser- 
vice consumer’s confusion and frustra- 
tion, make services more readily acces- 
sible, and assure greater service quality. 

first wave had arrived toward 
the end of the 1970s under the Carter 
Administration, but nothing much had 
come of this churning of the waters. 

The service integration movement was 
given new life a decade later due to the 
extensive economic restructuring oc- 
curring in the latter half of the 1980s 
and the early part of the 1990s. New 
problems were emerging in an econo- 
my now imbedded in fiercer interna- 
tional competition. 

Of particular concern was the degree 
of displacement of skilled blue collar 
workers, white collar middle managers, 
and other categories of workers in oc- 
cupational sectors affected by trade 
imbalances; the movement of firms to 
areas of cheaper investment and labor; 
the downsizing of the military; the re- 
configuring of corporations through 
mergers, buyouts and other kinds of 



consolidation; and the conscious 
shrinkage of business and industrial 
workforces in an effort to preserve and 
enhance profitability. 

At the same time, continuing tech- 
nological change was contributing to 
an ever-widening gap between educat- 
ed, skilled and high-wage workers and 
the undereducated, underskilled and 
low-wage. Both greater program coor- 
dination and more precise accountabili- 
ty were becoming accepted ways of 
dealing with these new postindustrial 
challenges. 

Background of Recent 
National Efforts 

Consistent with the times, there 
were renewed efforts at the national 
level to reduce duplication, become 
more efficient organizationally, and re- 
form service deliver)' systems in the 
user-friendly direction. Giving the inte- 
gration movement legitimacy was a 
new president who was actively en- 
couraging greater coordination not only 
from the bully pulpit but through new 
Administration-designed legislation. 
The purpose was to make coordination 
happen. 

Relatively early in its tenure, the 
Clinton Administration completed three 
interconnected proposals regarding hu- 
man resource development and coordi- 
nation: the Reemployment Act, which 
proposed pulling programs for the un- 
employed and dislocated together; the 
Welfare Reform Act, which included a 
greatly expanded and better coordinat- 
ed work/welfare system; and the 
School-To-Work Opportunities Act that 
sought to knit schools, training institu- 
tions, apprenticeships and workplaces 
together. In addition there was Ameri- 
corps. And beyond these reforms there 
were new defense conversion and di- 
versification programs that addressed 
the dislocation issue with military per- 
sonnel and with civilians and commu- 
nities affected by military cutbacks. 
These initiatives were laced with coor- 
dination mandates. 

These changes and related proposals 
involved unprecedented collaboration 
and coordination at the highest levels 
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of government — across the Depart- 
ments of Education, Labor, Health and 
Human Services, Agriculture, Com- 
merce, and Defense, in particular. The 
federal government was essentially pro- 
viding a viable coordination model in 
the way it was developing service inte- 
gration alternatives. 

Service providers, now well social- 
ized to thinking territorially, and essen- 
tially rewarded for doing so by funding 
policies, did not always embrace these 
reforms. In the evaluation research 
community, however, many social sci- 
entists were ecstatic. The public, the 
Congress, and the Administration 
seemed to be speaking with a single 
voice about workforce system evalua- 
tion, demanding that objective, science- 
based judgments of new initiatives — 
that is, of both their implementation 
and impact — be synonymous with 
“establishing accoimtability.” 

The Common Data Eiementa 
Project 

Faithful to the JTPA Amendments, 
the Departments of Education, Labor, 
Health and Human Services, and Agri- 
culture jointly sponsored a two-phase 
project beginning in 1993 to develop a 
core set of variables, operational defi- 
nitions and quantitative measures that 
cut across multiple employment and 
training programs. The ultimate goal 
was to integrate information production 
by standardizing the “information glos- 
sary” for the entire workforce prepara- 
tion system. A Workgroup on Common 
Core Data Elements was established, 
involving an impressive number of rel- 
evant organizations ahd constituencies. 

The first phase of the project has fo- 
cused on the identification of a com- 
mon set of data elements (measures) for 
use across programs in workforce sys- 
tems, and their common definition. In 
the summer of 1994, a draft report ti- 
tled Core Data Elements and Common 
Definitions for Employment and Train- 
ing Programs was released for com- 
ment and further revision. The discus- 
sion in this article is based on this 
initial draft report, which may undergo 
change as a result of the final approval 
process. 



The second phase will concentrate 
on the development of a common set of 
measures and definitions describing cli- 
ent statuses in workforce preparation 
systems: tlie status of clients entering, 
progressing through, and leaving the 
system. The workgroup is expected 
also to develop a common set of mea- 
sures and definitions for determining 
eligibility across workforce systems. 

The Historical Rationale 

Often viewed by policymakers and 
program managers as a ‘technical task^ 
for computer specialists and therefore 
somewhat removed from policy and 
management, information production 
concerning programs within the work- 
force development system (and con- 
cerning the system itself) actually re- 
flects critical policy decisions about 
what program features are most impor- 
tant These priorities subsequently af- 
fect the way programs are managed. 
Although information systems are 
meant to be a support for policies, in 
practice they often direct and redirect 
policies. Consequently decisions about 
what kind of information should and 
can be gathered for various purposes 
subtly channel program effort. 

Therefore this unprecedented effort 
to increase the coordination and inte- 
gration of workforce systems through 
access to common information about 
the programs within them is quite sig- 
nificant. And such access greatly en- 
hances the ability of administrators to 
monitor and evaluate such systems for 
policy purposes. 

Each program has come off the Con- 
gressional presses with its own linguis- 
tic patterns, tailored to its legislative 
era, the^ assumptions of its sponsors, 
and the nature of its program design. 
Different linguistic patterns tend to 
produce different program cultures and 
environments. Programs can become 
hostage to that inevitability. Preserving 
programs^ uniqueness, and protecting 
their rationales and intents from being 
eroded, these linguistic barriers also 
fight against coordination and integra- 
tion. Collaborative policy setting, plan- 
ning, program operation and account- 
ability activities suffer from a lack of 



willing, able translators and negotia- 
tors. Unfortunately this ends in ineffi- 
ciencies, and often in ineffective ser- 
vice provision and outcomes for 
workers and employers. 

‘ In this context, the 1992 JTPA 
amendments required that “a core set 
of consistently defined data elements” 
be identified which could be used for 
information-gathering across major 
federal employment and training 
programs, ilie Departments of Educa- 
tion, Labor and Health and Human Ser- 
vices followed these amendments with 
the Core Data Elements Project. They 
were joined la^'^r by the National Occu- 
pational Information Coordinating 
Council, the U.S. General Accounting 
Office, the Census Bureau, and the Na- 
tional Governors’ Association. 

The Product 

The Project’s workgroup recom- 
mended operational definitions and 
measures, or indicators (data elements), 
for key process and outcome variables 
across Adult Education, Vocational Ed- 
ucation, die Employment Service, 

JTPA Titles II and III, the Job Corps, 
JOBS, and Food Stamps. This accom- 
plishment was expressed in the form of 
a sizable compendium, which was re- 
viewed by experts and practitioners at 
the federal, state and local levels. The 
review was undeniably positive. In fact 
it was the reviewers’ conclusion that 
the project’s sponsors should expand 
the compendium to include variables 
relating to client status and eligibility. 

In the compendium, common defini- 
tions were provided for key terms used 
in the array of employment and training 
linguistic systems. These were to sup- 
port the use of the core data elements. 
The latter were clai llied within five 
groups: 

■ Demographic elements. 

■ Services received. 

■ Service completion. 

■ Program outcomes. 

■ Employment descriptors. 

The core elements are listed in Fig- 
ure 1 , excerpted directly from the 
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Demographic Elements 
Sodal Security Number 
Date of Birth 
Gender 
Rac^Ethnfcrty 
Disabled/Individual 
Educatii^Highest Formal Grade 
Level at Entry 

Highest Degree/Credential at Entry 
Labor Force Status at Entry 
Scheduled Hours of Work Per Week at 
Entry (If employed) 

Homeless Individual 
Veteran 

Public Assistance (federal, state, or lo- 
cal) 

Long-term AFDC Recipient 

Services Received 
Assessment esting 
Counseling/Career Development 
Job Search Assistance 
Occupational Skills Training (non- 
OJT) 

On~the-Job Training (OJT) 

Work Experience 

Pre-Employment Skill^Job Readiness 
Training 

Basic Skills Education through 8ih 
Grade 

Basic Skills Education at Secondary 
Level (9 through 12) 

English as a Second Language 
Postsecondary Academic Education 
(non-occupational) 

Supportive Services 



Service Completion 
Completion of Occupational Skills 
Training (non-OJT) 

Completion of On-the-Job Training 
(OJT) 

Completion of Work Experience 
Completion of Pre-Employment Skills/ 
Job Readiness Training 
Completion of Basic Skills Education 
through 8th Grade 

Completion of Basic Skills Education at 
Secondary Level (9 through 12) 
Completion of English as Second Lan- 
guage 

Completion of Postsecondary Academ- 
ic (non-occupational) Education 
Reasons for Not Completing Planned 
Service(s) 

Program Outcomes 
Advanced to Higher Level of Education 
or Training 

Attained Additional Degree/Credential 
Assessed Learning Gain in English as 
a Second Language 
Assessed Learning Gain in Basic Skills 
Entered Unsubsidized Employment 
Entered Subsidized Employment 

Employment Descriptors 
Scheduled Hours of Work per Week 
Earnings (Hourly or Annual) 

Occupation 



^Common definitions have been devel- 
oped for the Italicized terms. 



workgroup’s draft report. Definitions 
of tile data elements are listed in the 
draft report’s Appendix. Detailed there 
also are current differences between 
programs regarding 1) whether data are 
collected on individu^s, cases or ag- 
gregate characteristics, and 2) the num- 
ber and type of data elements collected. 
The report clarifies that progt^s may 
adopt the common definitions but 
choose to make selections from among 
the core elements, in moving toward 
more comprehensive information sys- 
tems. 

The Project’s sponsors requested 
that if programs represented in this ma- 
jor effort collect information on a sub- 
ject included within the core set, they 
should do so in a way that is consistent 



with the corresponding element and its 
common deJinitiofL Project participants 
are encouraged to add more detailed in- 
formation to their information systems 
consistent with the common defini- 
tions. In this way, sponsors hope this 
convergence toward a common under- 
standing of terms and indicators will 
yield a common set of forms and inte- 
grated data systems. 

The Benefits of Information 
Consistency 

Part of the prelude to this innovative 
project was a 1991 NGA survey of 
state and local policymakers and pro- 
gram administrators from 13 federally- 
funded education, training and employ- 
ment programs. The survey report. 



Streamlining a7id Integrating Human 
Resource Development Services for 
Adults, supported the need for a stan- 
dai’dized information system glossary. It 
also clarified that the benefits of coordi- 
nation were greater than its risks — 
greater flexibility in using funds, in- 
creased knowledge and communication, 
more efficiency in sexvice provision, 
greater ability to use specialized exper- 
tise, better monitoring, and enhanced 
performance. 

The report on the Core Data Ele- 
ments project also comments on the 
benefits of a more logical information 
collection approach, listing tlie follow- 
ing major advantages: 

■ Removal of identified barriers to the 
coordination and integration of ser- 
vices across employment and training 
programs at the state and local levels, 

a Enhanced program planning and 
oversight capability at the federal, 
state and local levels. 

«• Removal of barriers to efficient cus- 
tomer ser/ice. 

Prologue 

The work of the .lob Training 2000 
Performance Standards Subgroup in 
1991 revealed considerable ambiguity 
in the goals of programs and the lack of 
outcome measures in a number of them. 
Not surprisingly, the Subgroup recom- 
mended the establishment of a core set 
of performance outcomes. By 1993, the 
Government Performance and Results 
Act was requiring agencies to establish 
program goals, and performance mea- 
sures consistent with them. At the same 
time, the NGA Performance Manage- 
ment Project was pinning down some 
basic principles for establishing ac- 
countability in coordinated state work- 
force development systems, emphasiz- 
ing a logical progression from system 
goals to system performance measures. 

A core cluster of standardized defini- 
tions and measures was viewed as an es- 
sential dimension of state E&T “ac- 
countability systems.” 

Meanwhile, information system in- 
novations at both the federal and state 
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levels were beginning to capture infor- 
mation on participants* characteristics, 
services and outcomes across program 
territories, increasing the ability to 
track clients in coordinated systems. 
This was a significant achievement at a 
time when 39 states had developed 
one-stop centers. 

So with this kind of evolution in 
thinking about the important role of in- 
formation systems, the Core Data Ele- 
ments Project is looking at the compen- 
dium, and the additions made to it in 
the next phase of the project, as more 
of a launching pad than a landing 
place.They have recommended these 
subsequent steps: 

m The incorporation of the compendi- 
um of core data elements by addi- 
tional federal agencies, when report- 
ing requirements and new 
management information systems 
are developed, and by state councils 
and agencies involved in compre- 
hensive workforce development sys- 
tems. 

• The expansion of the core set into a 
comprehensive dictionary of com- 
mon definitions across education, 
training and employment efforts, 
maintained and updated by 0MB. 

■ The use of such a dictionary in de- 
veloping new legislation. 

It is to their great credit that the 
project’s sponsors hope to take their 
mandate further, to the ultimate end of 
this exercise, namely policy consisten- 
cy. The focus on information systems is 
to lead in this critical direction. 



■■ 

Comprehensive State 
Worf^rce Development 
Systems: Key 
Elements 

As a first step in a 1993 National 
Governors’ Association project consid- 
ering the goals and strategies involved 
in useful performance management sys- 
tems, NG A commissioned a monograph 
on these issues from the Center for Gov- 
ernmental Studies at Northern Illinois 
University. Authored by John Baj and 
Robert Sheets in 1994, Building State 
Worl^orce Development Systems Based 
on Policy Coordination and Quality As- 
surance did more than provide a frame- 
work for NGA’s Performance Manage- 
ment Project Its perspective on the 
statewide coordination of policy and 
service provision, and on the evaluation 
of state workforce systems, links evalu- 
ation research principles and methods 
with the principles of management and 
program operation, giving attention to a 
range of accountability issues rarely dis- 
cussed simultaneously or merged in a 
single approach. 

Inputs versus Outputs: The 
Authors’ Position 

The authors begin with the conclu- 
sion that we have lived for several de- 
cades with an imbalanced focus on in- 
puts (service “treatments”) to the 
exclusion of adequate output (outcome) 
measures. We have essentially empha- 
sized the quality of services and service 
systems, failing to hold programs ac- 
countable for their results. But profes- 
sionals are beginning to question wheth- 
er the pendulum has swung too far to 
the output side. The belief that 
mance standards can lead sometimes to 
selecting those most apt to succeed and 
can inappropriately redirect a program’s 
intent, and foat not meeting standards 
may torpedo programs important to pre- 
serve and refine, has led to new cau- 
tions. 

So Baj and Sheets take a middle po- 
sition on the swing of the pendulum. 
They say that an exclusive emphasis ei- 
ther on inputs or outputs denies us ade- 



quate information for improving pro- 
grams and suggesting major reforms. In 
that vein, they recommend! the follow- 
ing: 

» Simultaneous study of a program’ s 
or a system’s 1) organizational and 
service delivery policies and pro- 
cesses, and 7) its outcomes and 
longer-term impact, ox performance, 

B Promotion of continuous improve- 
ment in the organization and opera- 
tion of programs or systems through 
the use of a combination of 1) pro- 
cess standards and 2) outcome stan- 
dards (performance standards). 

■ Use of a capacity-building (quality 
assurance) system for adopting 
“best practices,” based on the results 
of process and outcome studies, and 
for the purpose of continuous im- 
provement. 

The authors summarize their posi- 
tion in stating that “the major challenge 
in building cohesive workforce devel- 
opment systems for labor market en- 
trants, unemployed workers and eco- 
nomically disadvantaged individuals is 
to improve the quality of programs and 
service delivery throughout the system 
while achieving greater accountabili- 
ty.” Therefore the purpose of their re- 
port for NGA is to suggest a conceptual 
model that is responsive to that kind of 
mandate. 

The authors sketch the model in this 
way. The outer boundary is a “broad 
policy coordination framework” de- 
fined in terms of a logical, internally 
consistent progression of priorities: the 
system’s mission; its goals and objec- 
tives; its implementation strategies; its 
desired outcomes; its target groups, 
client eligibility criteria and types and 
intensities of services; and its allowable 
costs. Quality assurance is seen as a 
mechanism for maintaining and en- 
hancing the structures and functioning 
of this coordinated system. Quality as- 
surance systems are viewed as having a 
performance management component 
which guides the workforce develop- 
ment system in the direction ofits goals 
and objectives, and supports continu- 
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ous improvement in system processes 
and outcomes. 

The performance management com- 
ponent is expected to accomplish the 
following: 

■ Incorporate the principles of continu- 
ous improvement. 

» Judge the entire system^s perfor- 
mance, as well as the pcrfoimance of 
programs within it. 

B Make these judgments using multiple 
measures of outcomes, including ed- 
ucational achievement, occupational 
competencies, customer satisfaction, 
educational and employment contin- 
uation, employment retention and 
earnings, and industry-based skill 
standards. 

B Use a common set of outcome vari- 
ables, definitions, measures and per- 
formance standards in arriving at 
these judgments. 

B Offer incentives and apply sanctions 
associated with perfonnance stan- 
dards, including capacity-building 
assistance. 

Although the various concepts in this 
1990s “system”-oriented vocabulary — 
quality assurance systems enclosing 
performance management systems, and 
performance management systems en- 
compassing continuous improvement — 
are not always as clearly defined or as 
well differentiated from one another as 
one might wish, the monograph is enor- 
mously significant and useful. Let's 
look further into it. 

Quality Assurance 

The establishment of quality assur- 
ance systems, as an element of adminis- 
trative coordination, should respond, the 
authors say, to customer-defined out- 
come standards. They claim that quality 
assurance systems require “the major 
restructuring and integration of all per- 
formance standards, skill standards, and 
related program accreditation and certi- 
fication standards used by federal and 
state workforce development pro- 



grams,” and should encourage better 
communication between the public and 
private sectors. We should investigate 
this perspective on performance stan- 
dards. 

As mentioned earlier, the authors 
distinguish between process, or design 
standards, and performance, or out- 
come, standards: 

B Process standards: address specific 
characteristics of the service deliv- 
ery process, such as internal organi- 
sational policies and procedures, 
assessment and instructional ap- 
proaches, staff qualifications, and 
monitoring and evaluation strate- 
gies. 

e Performance standards: address the 
results of service interventions, or 
“treatments,” on those receiving 
them, including desired changes in 
their academic and occupational 
competencies vis-a-vis national and 
state skill standards. 

Monitoring and evaluation are es- 
sential functions in arriving at objective 
judgments of the movement toward 
compliance with these standards. And 
movement toward the standards is 
viewed as supporting a commitment to 
continuous quality improvement. The 
authors seem to be saying that the dual 
emphasis on judging the quality of both 
the design aspects of the workforce sys- 
tem and its perfonnance is a new devel- 
opment. However, a more equal em- 
phasis on process and outcomes came 
into vogue in tlie late 1980s, even 
though it could only be applied to indi- 
vidual programs in the absence of com- 
prehensive coordinated workforce sys- 
tems. What is new is this dualism in 
passing judgment on the new networks 
of programs. 

The authors do not neglect, in their 
model, subsystem quality assurance. 
They propose three major quality assur- 
ance functions at the level of programs 
within workforce systems: 

■ Trainee credentialing and recogni- 
tion: educational credentialing, state 



occupational licensing and certifica- 
tion, and private professional certifi- 
cation and recognition systems. 

e Supplier certification and recogni- 
tion: training and technical assis- 
tance related to the certification of 
suppliers (service providers). 

■ Program and subsystem perfor- 
mance management: monitoring and 
reporting performance based on de- 
sired outcomes and standards, and 
diagnosing performance problems. 

Baj and Sheets insist that the devel- 
opment of common sets of standards is 
essential to perfonnance management 
and therefore to quality assurance at 
any level of the workforce system: that 
is, educational and occupational skill 
standards and credentialing systems; 
perfonnance standards; and supplier 
process and outcome standards and cer- 
tification requirements. 

The authors are unequivocal about 
the role of evaluation. The improve- 
ment of system performance, and the 
performance of programs within the 
system, “require a strong linkage be- 
tween performance management and 
evaluation.” This linkage supports and 
reinforces continuous improvement. 
Evaluation, they suggest, plays several 
roles: 

■ To validate quality standards. 

■ To diagnose perfonnance problems. 

■ To establish continuous improve- 
ment as a supplier process standard. 

Figure 1, excerpted directly from the 
report, gives us an overview of this part 
of the authors' model. The authors 
fine the traditional role of evaluation 
research as focusing on basic provision 
decisions (who should receive what 
type of services and at what cost), and 
assessing the returns on high-cost ser- 
vices (such as case management) to tar- 
geted populations. Evaluation research- 
ers will likely quarrel with this view. 

As part of a management system, the 
authors feel evaluation should provide 
decisionmakers with information on the 
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"^validi^ and cost-effectiveness of all 
imyor provision decisions.’* Their ex- 
tension of the role of evaluation re- 
search to validating process and out- 
come standards stretches that role 
considerably^ perhaps unrealistically 
and inappropriately. 

Evaluation research has been of 
greatest use in providing the least 
biased information about the nature 
of service provision and its results for 
clients. In the process, it can contribute 
information atout the level of compli- 
ance with performance standards. But 
the validation of quality standards has 
not been witf 'n its purview. 

The authors claim that evaluations 
of national programs and demonstra- 
tion projects have not been designed to 
improve the ongoing delivery or pro- 
duction of workforce development ser- 
vices. This is open to debate. It is true, 
however, that evaluations have not fo- 
cused on different kinds of service pro- 
viders at the point of service delivery, 
which the authors feel must be a re- 
quiiement of performance management 
systems mtkin quality assurance sys- 
tems within workforce development 
systems, if continuous improvement re- 
quirements are to be met. 

Some evaluation researchers have 
concliBded that some of the program 
outcomes typically measured are not 
necessarily good indicators of longer- 
term impacts. But the authors take this 
conclusion a step further by interpret- 
ing it to mean that some measures are 
not valid indicators of program impact. 
Indicator validity usually refers to the 
extent to which a particular measure or 
group of measures accurately represent 
the outcome variable being measured. 
Determining indicator validity is a sci- 
entific process. One cannot simply leap 
from position A — i.e,, the conclusion 
that measures such as job placement 
and off-welfare do not necessarily pre- 
dict well to net earnings and welfare 
savings — to position B — i.e., the 
first two measures are not valid indica- 
tors of the latter two. 

The authors suggest that outcome 
measures be weighted and adjusted so 



as to become effective indicators of net 
impacts, based on the differing charac- 
teristics of client groups (unskilled vs. 
skilled, for example). But effective and 
valid are two different things. Further- 
more, weighting and adjusting are more 
appropriate in judging compliance with 
performance standards than in inter- 
preting program outcomes, it being 
possible to disaggregate results for dif- 
ferent client gi’oups in interpreting data 
analyses. 

Confusing also is the authors* final 
conclusion about the differences be- 
tween evaluation and management 
Having advocated for evaluation as an 
integral part of performance manage- 
ment systems, they later differentiate 
between evaluation and performance 
management by pointing to the infre- 
quency of impact evaluation and the 
need for performance management sys- 
tems that supply more immediate fe^- 
back to administrators, program opera- 
tors and service providers. Therefore 
they comment that “quality assurance 
systems ai*e largely concerned with out- 
come and process questions that 
emerge from accountability rather than 
impact issues.” What does that mean? 

Are they saying tliat evaluation re- 
search can contribute to performance 
management but is not suited to an on- 
going oversight role? Performance 
management begins to look a great deal 
more like an expanded version of com- 
pliance monitoring, rather than as a 
source of objective, science-based in- 
formation about the critical relation- 
ships between client characteristics, 
seivices, and outcomes. 

The authors also say that continuous 
improvement should involve ongoing 
organizational self evaluation through 
internal review teams, as well as 
through third-party process and impact 
evaluations. And tliC basis for continu- 
ous improvement should be a clear def- 
inition, they suggest, of what “im- 
provement** is to mean, in the form of 
criteria and standards. This definition 
process is to be applied at all levels: the 
system as a whole, the programs within 
the system, and the service provider or- 
ganizations involved. 



Information Systems 

Without adequate data, quality as- 
surance systems can accomplish little. 
Therefore, the authors recommend that 
automated management information 
systems at all levels must be capable of 
supplying the kind of infonnation 
needed to implement the various over- 
sight strategies suggested in their re- 
port. The emphasis is on a common set 
of quality indicators for process and 
outcomes. A related inteiest is in the 
development of standardized instru- 
ments, meeting scientific standards, for 
conducting customer satisfaction sur- 
veys. The authors also recommend the 
development of cost-effective methods 
for gathering and analyzing informa- 
tion at the point of service delivery, to 
serve supplier certification purposes 
and to provide a basis forjudging con- 
formance with qualify standards. This 
should be paired, they indicate, with ef- 
forts to train suppliers in the continu- 
ous improvement process and provide 
ongoing technical assistance to them. 

Major Recommendations 
In the Report 

There are tluree key recommenda- 
tions: 1) the encouragement of state 
experimentation and demonstration in 
policy coordination and quality assur- 
ance; 2) the development of federal- 
state initiatives for establishing a quali- 
ty assurance system within a national 
policy coordination framework; 3) the 
promotion of federal-state initiatives 
for developing a national policy coordi- 
nation framework beyond quality as- 
surance. The positioning of the recom- 
mendations reflects the authors ' belief 
that initiatives should begin in the 
states, and build toward a national 
framework. 

What do these recommendations in- 
volve? 

■ Recommendation #1: States are 
identified as the location for experi- 
mentation, but the federal govern- 
ment is expected to 1) encourage 
and assist states in experimenting, 
and in testing policy coordination 
frameworks that include school-to- 
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work, workforce entry, and worker 
retraining and transitioning, and 2) 
develop a national policy coordina- 
tion fir^cwork for all publicly- 
funded workforce development pro- 
grams. 

■ Recommendation #2: Several na- 
tional initiatives should contribute to 
state experimentation: 

♦ Linking national skill standards 
to state quality assurance sys- 
term. 

♦ Restructuring public and private 
program accreditation and certifi- 
cation systems. 

4 Establishing national/state capac- 
ity-building programs supporting 
quality assurance. 

♦ Linking evaluation to perfor- 
mance management within the 
quality assurance system. 

With respect to the last initiative, the 
authors suggest that the results of im- 
pact evaluations should be used within 
the quality assurance system to exam- 
ine policy decisions, their implementa- 
tion, and the validity of quality stan- 
dards. Agam, it may be more accurate 
to talk aboi t the appropriateness and 
utility of quality standards. 

Comments on the Report 

Despite some fuzziness in distin- 
guishing among system-defining con- 
cepts, the overall model the authors 
propose is admirable. It includes all the 
major elements reflected in what we 
have learned from experience, expert 
opinion and research about policy de- 
velopment, administration, planning, 
program operation, service delivery and 
oversight, bringing these elements to- 
gether within a coordinated system. In 
developing this model they ably resist 
the temptation to ignore the different 
levels of human resource activity — the 
equally important national, state, pro- 
gram-specific, and service delivery- 
specific, levels. State workforce devel- 
opment councils and boards, and 
pre jram administrators operating with- 
in comprehensive systems, will find 
this report stimulating and useful. 



The National 
Governors’ 
Association 
Performance 
l\/!anagement Project 

With funds from the Joyce Founda- 
tion, NGA worked with the Center for 
Governmental Studies at Northern Illi- 
nois University in 1993 to develop a 
conceptual framework for improving 
services and accountability across 
workforce programs, with a special in- 
terest in the development of compre- 
hensive state workforce systems. This 
framework was described in NGA’s 
pv!oY\CdX\Qr\y Building State Workforce 
Development Systems: The Critical 
Roles of Policy Coordination and 
Quality Assurance. This monograph 
was prepared in anticipation of a six- 
state project sponsored by NGA, and 
served as the major resource material 
for that project. 

Phase One: The NGA Working 
Paper 

The concept proposed in the mono- 
graph was a performance management 
system that incorporated quality assur- 
ance and continuous program improve- 
ment in a model that allowed policy- 
makers and planners to judge 1) a 
workforce system’s implementation 
(how it was organized and made things 
happen, including its level of coordina- 
tion); 2) its participants’ outcomes; and 
3) the system’s impact and net effects 
judged against its most significant 
goals. The idea of “continuous im- 
provement” was considered to involve 
ongoing self-evaluation, and a redesign 
of various elements of the workforce 
system in response to that evaluation. 
The notion of “quality assurance” in- 
volved the development and use of per- 
formance standards, educational and 
occupational skill standards, and stan- 
dards forjudging the operation of the 
system. The concept placed heavy em- 
phasis on evaluation research and the 
innovation it was capable of encourag- 
ing. 



Phase Two: The Six-State 
Accountability Effort 

Following the production of the 
monograph, in the spring of 1994 NGA 
invited states vrlth state-wide work- 
force boards or councils to apply for 
xeclinical assistance to develop an ac- 
countabiluy model for their workforce 
development systems — i.e. to apply 
for a second phase of the performance 
management project. 

Technical assistance was to be made 
available for fifteen months, the first 
twelve of which were to be devoted to 
the development of a state performance 
management model. Funds for this as- 
sistance were to be provided by two 
private foundations — the Joyce Foun- 
dation and the John D. and Catherine T. 
Mac Arthur Foundation, and the U.S. 
Departments of Labor, Education, and 
Health and Human Services. This phase 
was to be coordinated with the National 
Institute for Literacy’s performance 
management project 

The states selected on a competitive 
basis to receive assistance were expect- 
ed to design outcome-based account- 
ability models for i) preparing youth 
for the school-to-work transition, 

2) retraining and transitioning of other 
workers, and 3) helping disadvantaged 
adults and those with multiple barriers 
to enter and re-enter the workforce. The 
six states were to serve as laboratories 
for establishing accountability across 
workforce development programs. The 
concepts of quality assurance and con- 
tinuous program improvement were to 
be dimensions of the models these 
states were to develop for application 
in their own state and for potential use 
elsewhere. 

The RFP Process 

NGA’s project RFP made the as- 
sumption that many states were now in 
the process of restructuring their work- 
force development systems into what 
was described as “seamless, customer- 
driven delivety systems” in response to 
these well-recognized problems: di- 
verse and often contradictoty federal 
and state program goals, performance 
expectations, funding incentives, oper- 
ational rules and regulations, and defi- 
nitions of program terms. The RFP 
considered the participating states to be 
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developing performance management 
models for much larger entities than 
those to which performance manage- 
ment principles had been applied in the 
past — this time to comprehensive 
state-wide workforce systems, not 
merely to individual programs or sets 
of related programs within such sys- 
tems. The design of requests for waiv- 
ers to federal and state statutes and im- 
plementing regulations were dearly to 
be part of participating states* responsi- 
bilities. 

More specifically, states applying 
for the project were expected to pro- 
duce the results listed in Figure 1. The 
ultimate goal, in developing perfor- 
mance management models, was to 
support the survival and enhancement 
of a single integrated workforce system 
— one in which key system functions 
such as policymaking, coordination, in- 
formation production, monitoring and 
evaluation v/ould be commonly defined 
and applied across an array of work- 
force programs. This kind of standard- 
ization was to result in a more orga- 
nized, efficient and accountable 
organizational structure and service de- 
livery system. 

Clearly the RFP was asking a great 
deal. But states were receiving some- 
thing important in return — assistance 
from research experts at the national 
level who were not otherwise available 
to them, validation of their approaches 
to accountability from their peers, and a 
certain level of national notoriety for 
contributing to the dialogue on system 
coordination. 

The Selection of Project 
Participants 

NGA*s selection criteria focused on 
the following issues: 

■ How the applicant would build on 
and enhance current state efforts to 
develop comprehensive workforce 
policies, integrate local planning and 
service delivery, and develop and 
use common monitoring, perfor- 
mance and evaluation standards 
across programs. 

■ What priority groups would be em- 
phasized by the appliconli 

■ How appropriate and feasible the ap- 



m 



figure 1. ;*..Expect9tjo'(«;forf;ta 



■ Create a plan for the development 
of the performance managemenfi 
model that will outline the action 
steps to be taken, Including the pro- 
cess to be pursued, the deliver- 
ables, the tlmollnes, and the 

cai assistance needed. 

« involve the state’s workforce board 
or council. 

» Invest service providers In the 
project. 

® Designate an Interagency policy 
team and a technical workgroup, 
and identify a coordinator wiro wii! 
head the policy team and act as ;h ^ 
liaison with NGA. 

• Focus on three priority groups of 
workers —youth, adults needing re- 
training, and disadvantaged work- 
ers — with the option of gMng 
greater emphasis to one or moro of 
these. 

■ Establish a set of stato goals for the 
state’s workforce syslenie for each 
priority group. 

■ Identify quantifiaol® outcomes for 
the system, for each priority group, 
given these goals. 

* Develop a common glossary of pro- 
gram terms for the system. 

Develop a common set of opera- 
tional definitions and quantitative 
measures for the key factors to be 
studied In judging Us© accountabiii^y 
of the system. 



plicant’s project organization plan 
appeared to be, and the strength of 
the state’s commitment to attending 
the three national meetings. 

■ How clearly the applicant had artic- 
ulated technical assistance needs. 

■ How substantial the results of the 
project were to be* 

Applicants who planned to focus on 
all three groups of workers were given 
preference. In an effort to assure diver- 
sity in the models developed, other fac- 
tors were considered, such as the com- 
plexity of the applicant’s workforce 
system, the nature of the institutional 
environment of the system, the size of 
the state applying, and its geographical 
location* 



s Develop speciffo moRitoring and eval- 
uation methods for holding state and 
Socsl program managsrs accountable 
for achieving system goals. 

H Incorporate qualify assurance and 
continuo^js program improvement 
within the perfomiance management 
model. 

R Develop ccw^pationaS standards for 
use across programs within Ihe sys- 
tem. 

« If desired, develop an incentive/sanc 
tion system for rewarding successful 
system operation and performance, 
or for providing tez^tnical assistance 
to resolve system problems. 

i Define federal, state and local over- 
sight roles and responsibilities vis-a- 
vis the system. 

I Refine the rriOdef, working with na- 
tlonai experts. 

1 Participate in interstate coordination 
efforts, and share information and 
problems with other states in the 
NGA project. 

Participate in three project meetings 
sponsored by NGA. 

Identify federal and state regulatory 
barriers to applying the model. 
Produce a state-approved report on 
the twelve-month design phase, 
which details the dimensions of the 
state’s model end presents a plan for 
Implementing rt, 

Hegin to implement model davei- 
oped. 



Based on the above criteria, six 
suites were to be selected. The current 
status of each of these stales’efforts to 
develop a performance management 
strategy for its comprehensive work- 
force system was to be taken as the 
baseline for Judging Us progress over 
the life, of the project. Each of the na- 
tional iueetings was to further refine 
each state’s mode! through inputand 
materials from the national consuitants, 
structured peer reviews, and the sharing 
of information on common issues. 
Stales would be able to obtain technical 
assistance from Ihe consultants and 
from NGA staff on-site, and through 
con ference calls and correspondence. 
Representatives from any of the six 
states could share information and ad- 
vice on*sit6 with other states if this 
seemed usefiil* 
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The Tschr/jcal Assistance 
Offered 

These were the kinds of technical 
assistance states could access in the 
project: 

1. The provision of reports and work- 
ing papers from NGA’s Reinventing 
Government Task Force, appropriate 
private sector representatives, and 
national experts. 

2. The provision of information on 
successful state practices. 

3. The outlining of a process for dis- 
seminating and utilizing research 
findings for local program planning. 

4. The provision of information on a 
set of process and outcome criteria 
for contirtuous program improve- 
ment and self-assessment. 

5. The provision of assistance with the 
development of waiver requests. 

6. The provision of information on leg- 
islation, and reports on school-to- 
work perfonnance measures, adult 
education quality indicators, com- 
mon data definitions and measures, 
and the use of UI data. 

7. The provision of a list of consultants 
specializing in performance manage- 
ment. 

The Selection of Project States 

Tiiirteen states applied to be part of 
tlie NGA project. The following six 
were selected: Illinois, Iowa, York, 
North Carolina, Texas and Washing- 
ton, 'Fhese states were considered to 
have made significant progress in re- 
structuring their range of workforce de- 
velopment programs and projects into 
high-quality, more customer-driven 
workforce preparation systems. In the 
NGA project Aey were expected to 
take a subsequent step: to develop “the 
next generation” of performance man- 
agement systems, which would incor- 
porate the concepts of quality assurance 
and continuous improvement, and 
would stress joint accountability across 
different programs and levels of gov- 
ernment. Given the Clinton Adminis- 
tration’s efforts to restructure and con- 



solidate at the federal level, the states 
selected were to have an opportunity to 
work closely with relevant federal 
agencies. 

Project Orientation 

To prepare the six states to under- 
take a clearly-defined common mis- 
sion, even though their accountability 
models would reflect the diversity of 
their circumstances and interests, NGA 
held the first of three national project 
meetings in Detroit in mid-June, 1994, 

A number of working papers were pro- 
vided to give participants a framework 
for carrying out the mission. These in- 
cluded the substantial report. Building 
State Worl^orce Development Systems, 
and the first draft of the report prepared 
by the Workgroup on Common Core 
Data Elements, Core Data Elements 
and Common Definitions, 

The materials also included the Na- 
tional Institute for Literacy’s 1994 re- 
port, A Guide to Strategic Planning for 
Performance Measurement, Reporting 
and Improvement Systems, an issue pa- 
per prepared by NGA for the first 
project meeting, and an overview of 
Texas* process for developing core per- 
formance measures^ 

NGA also outlined general expecta- 
tions regarding the characteristics of 
the accountability models the states 
were to develop: 

m Measurable state-wide goals for : 

1) youth transitioning from school 
to work, 2) workers needing retrain- 
ing and transition assistance, and 
3) adults with multiple barriers to 
employment. 

■ A common set of measurable de- 
sired outcomes for the customers of 
the workforce development system. 

■ State and local performance stan- 
dards consistent with the desired 
goals and outcomes. 

■ A common information system 
(variables, definitions and measures> 
for reporting progress against the 
goals. 

■ Joint accountability across the sys- 
tem for achieving the goals and 
meeting perfonnance standards. 



NGA also provided participants witli 
a Glossary of Performance Manage- 
ment Terms which was an extremely 
useful tool for sharing insights across 
the participating states. 

General Ideas in NGA’s 
Issue Paper 

As a context, NGA staff reminded 
states in the paper that the quality of 
educational and other workforce devel- 
opment programs has been judged tra- 
ditionally on the basis of accreditation 
criteria, program approval processes, 
and planning requirements oriented to 
compliance with rules and regulations 
concerning inputs. The pendulum had 
swung, they said, in the direction of 
judging outcomes — replete with in- 
centive/sanction strategies, affording 
flexibility in the design and refining of 
programs, and relying on competition 
to promote high quality. However, they 
acknowledged that an emphasis on both 
inputs and outcomes was important, 
and that a commitment to continuous 
improvement must involve an interest 
in both. 

The new wrinkle in this ongoing di- 
alogue about accountability, they pro- 
posed, was the emergence of more 
comprehensive and coordinated service 
systems that cut across individual pro- 
grams. This has generated interest and 
concern about how to appropriately 
judge system-wide processes and out- 
comes. Homogeneity of program terms 
and goals is merely an essential preface 
to developing system-wide visions, 
benchmarks, goals, objectives, outcome 
expectations, and performance stan- 
dards. 

The movement is toward what NGA 
terms system-wide shared accountabili- 
ty, This approach envisions a system 
with these dimensions: 

a A set of measurable policy goals for 
the entire state. 

■ A set of measurable goals for the 
. workforce development system con- 
sistent with state policy goals. 

51 A common set of measurable out- 
comes for all workforce develop- 
ment programs within the system, 
consistent with the goals for the sys- 
tem. 
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■ A single incentive/sanction strategy 
that can be applied system-wide to 
support the achievement of system 
goals. 

a A commitment to ongoing self-eval- 
uation to determine the level of 
progress in achieving system goals. 

This directs a very logical progres- 
sion of thinking and planning. Howev- 
er, it is questionable whether state-wide 
policy goals can be stated such that 
they are measurable in tlie same sense 
as system and program outcomes can 
be measured. Benchmarks are by nature 
abstract and difficult to measure either 
qualitatively or quantitatively. 

In discussing this progression, the 
writers of the issue paper distinguish 
between performance management 
tasks and continuous improvement 
tasks. They suggest that goal/outcome 
development is the former type of task, 
and evaluation research and capacity 
building the latter kind. However ^ eval- 
uation researchers would likely consid- 
er evaluation research activities to be 
an integral part of a comprehensive 
performance management system 
which incorporates quality assurance, 
continuous improvement, and the iden- 
tification of *‘best practices.” 

The issue paper poses some very im- 
portant and useful questions: 

1. What should be the roles and re- 
sponsibilities of federal, state and lo- 
cal governments and the private sec- 
tor in promoting and assuring shared 
accountability? 

2. Does there need to be shared respon- 
sibility for planning and oversight at 
each level of the system, and what 
kind of governance arrangements 
should be put in place to assure 
shared accountability? 

3. How can the contribution of each 
funding stream to the collective ef- 
fort be determined and judged? 

4. Is it enough to have information sys- 
tems with common definitions and 
measures of outcomes, or are inie* 
grated data systems needed which 
offer customer information, case 



management information, monitor- 
ing information and evaluation re- 
sults? 

5. Is it useful to focus on the different 
populations served, or should there 
be a general accountability policy 
that applies to all customers? 

6. How should program outcomes be 
linked to outcome expectations for 
the system as a whole, and what 
should the consequences be for 
meeting, exceeding or failing to 
meet system-wide performance ex- 
pectations? 

The Survey Undertaken by the 
Texas Council on Workforce and 
Economic Competitiveness 

The Performance and Evaluation 
Committee of the Texas council con- 
ducted a survey of eleven national ex- 
perts in the performance management 
field. The survey instrument consisted 
of a questionnaire with ten discussion 
questions. The experts were asked to 
respond in writing and subsequently 
through telephone interview. Eight 
responded. Some of the major insights 
from the survey are summarized in the 
sections below. 

Labor Market Outcomes 

B Multiple quantitative and qualitative 
measures of key factors should be 
developed to compensate for defi- 
ciencies in any one indicator, al- 
though the system must remain man- 
ageable. 

■ Measures should not only include 
sheer outputs, such as placement 
rates, but indicators that provide in- 
formation on changes over time, 
such as wage rates. 

B Adjustments in performance stan- 
dards, although to be kept to a mini- 
mum, should consider local eco- 
nomic conditions and the 
characteristics of participant popu- 
lations. 

■ Core measures to be used across a 
workforce system should be a first 
step in performance management de- 



velopment, with performance stan- 
dards phased in incrementally so as 
to take advantage of program infor- 
mation which can inform the choice 
of standards. 

■ Measures of clients * access to the 
system should be included, as they 
are important indicators of service 
provision equity and the level of re- 
sponse to key target populations. 

■ Key outcomes to track are: labor 
market outcomes, learning out- 
comes, and client/employer satisfac- 
tion outcomes. 

Survey respondents expressed cau- 
tions as well as making recommenda- 
tions. They viewed “entered employ- 
ment rate” as a good measure if used 
with other measures such as “employ- 
ment retention,” the “appropriateness 
of the job,” and “the degree of self-suf- 
ficiency.” However, they pointed out 
that placement rates might not be ap- 
propriate forjudging educational pro- 
grams or further training. They did not 
think “training-related placement rates” 
were useful in all cases because of 
1) the ambiguity of definitions of 
“training-related,” 2) the uneven im- 
portance of this measure in educational 
and employment assistance vs. occupa- 
tional skill training programs, and 3) its 
different meaning for longer-term spe- 
cialized occupational training than for 
short-term training. Nevertheless, in 
some instances and with some training, 
they considered the training-related 
measure very important. 

All agreed that “wage rate” mea- 
sures were important. However, they 
felt it Vv'as difficult to sort out their 
meaning vis-a-vis other factors such as 
economic changes, or personal attitudes 
and situations. They also agreed that UI 
Wage Record information was the best 
source of information on “earnings,” 
“employment affiliation,” and the char- 
acteristics of firms where program par- 
ticipants were placed. They recognized 
that tracking information specific to 
particular occupations, developing indi- 
cators for the quality of jobs, and dis- 
tinguishing between full-time and part- 
time employment in the wage records 
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were a problem. They were ambivalent 
about client interviews as a way to en- 
hance the information on wages, be- 
cause of the general unreliability of 
self-report data, but thought this strate- 
gy was feasible if used in combination 
with UI data. 

All the experts surveyed recom- 
mended the use of “job retention” mea- 
sures used in combination with place- 
ment indices. This could best be done, 
they suggested, by using information 
from the UI files, by conducting cus- 
tomer service surveys, and collecting 
additional information on benefits and 
career ladders. But there were caveats. 

It is difficult to track employment over 
time as people move in and out of jobs. 
Also, the value of retaining a given job 
may not be high if it translates to a lack 
of mobility. 

Learning Outcomes 

■ Possession of a GED, a post-second- 
ary educational certificate, a license, 
or a degree are important indicators 
of learning outcomes. 

u Multiple measures are needed, how- 
ever, including “skill attainment”, 
“job placement” and “job retention.” 

There was unanimity about measur- 
ing skill attainment, but respondents 
acknowledged the difficulty of devising 
measures in the absence of well-de- 
fined credentials and licenses for most 
occupations. They were hopeful that 
the National Skills Standards Board 
under Education Goals 2000 would re- 
duce these problems. Some experts 
suggested that the first step should be 
to define occupational and/or industry 
skills standards needed for a given oc- 
cupation and/or industry, and then al- 
low those standards to shape training 
curricula and programs. 

Project States’ Accountability 
Concepts 

The states that applied for and were 
selected to participate in NGA’s Perfor- 
mance Management Project proposed 
similar concepts and tasks consistent 
witl) NGA’s framework. However, 
there was a range of responses to the 
RFP related to the unique situation of 



the six states and the history of their re- 
cent efforts to coordinate multiple edu- 
cational, training and employment pro- 
grams to create a new workforce 
‘system*. Figures 2 and 3 provide a 
brief overview of the content of their 
responses. 

Some Observations About the 
RFP Responses 

Of the six states participating in the 
NGA project, Washington State ap- 
pears to have done the most thinking 
about the requirements of an account- 
ability model that utilizes scientific 
principles and methods that are now 
well established evaluation research ap- 
proaches. Although Washington is con- 
tinuing to explore the issue of general 
benchmarks and measurable goals, ob- 
jectives and outcomes, no other state 
proposed the kinds of scientific sur- 
veys, process evaluations, and net im- 
pact studies recommended by the 
Washington workforce board. 

Mid-Project Progress 

In November 1994 the states partici- 
pating in the NGA project met to report 
on their progress. The informal reports 
they shared were guided by NGA’s pri- 
orities for covering the key elements of 
performance management systems. In 
general, these elements were the fol- 
lowing: 

■ The definition of “accountability.” 

B The mission of the workforce sys- 
tem. 

B The system’s purpose. 

B Long-term benchmarks. 

B Shorter-term policy goals. 

B The system’s building blocks. 

B The key features of the system. 

B Its participants and stakeholders. 

B Its set of roles and responsibilities: 
federal, state and local. 

B The target groups for service. 

B The larger environment of the sys- 
tem. 

B The outcomes expected of the sys- 
tem, given its goals. 



B The measures to be collected, repre- 
senting these outcomes. 

The Illinois progress report followed 
this logical sequence of decisions 
closely. Twelve programs were includ- 
ed in the system. State policy goals en- 
compassed early childhood develop- 
ment, educational performance 
standards, a school-to-work system, lit- 
eracy and high school equivalency, 
professional and technical degree and 
certificate programs, worker retraining, 
and economic independence and long- 
term employment. Significant out- 
comes were the acquisition of academ- 
ic, occupational and basic workplace 
skills; the realization of sustained em- 
ployment and earnings; customer satis- 
faction; and reduced welfare dependen- 
cy. 

Iowa placed specific timeframes 
aroiuid these system elements utilizing 
these guiding principles: a focus on the 
customer, an emphasis on system out- 
comes, and a commitment to shared ac- 
countability, continuous improvement, 
greater collaboration in workforce de- 
velopment planning and execution, and 
flexibility. 

New York's benchmark-develop- 
ment process consisted of three phases: 
1) planning, 2) data collection and 
analysis, and 3) reporting, building on 
twenty key components derived from a 
study of the research and business liter- 
ature, federal legislation, and other 
states’ efforts. System goals gave spe- 
cial attention to simplicity, quality and - 
accountability: 

B Efficient and comprehensive plan- 
ning and policy direction. 

B Service integration. 

B Targeting of education and training 
services to customers. 

B Responsiveness to world-class edu- 
cational and training standards. 

B Resource allocation tied to the prior- 
itization of activities and their dem- 
onstrated effectiveness. 

North Carolina *s report outlined the 
workforce system’s benchmarks, strate- 
gic policy recommendations, policy 
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Previous Accomplishments 



Technical Assistance Requested 



« Task Force on Human Resource De- 
velopment developed 7 goals: 

♦To develop comprehensive early 
childhood development system. 

♦ To establish standards for educa- 
tional performance. 

♦To Institute comprehensive school- 
to -work transition system. 

♦To develop s) stem giving assis- 
tance to out-of-schooi youth and 
disadvantaged adults falling to 
meet educational standards. 

♦To develop sy^^tem for awarding 
technlcal/professlonal certificates/ 
degrees based on mastery of skills. 
♦To urge employers to Invest in re- 
training as major strategy for high 
performance work organizations. 
♦To provide access to coordinated 
system of education, training, case 
management and supportive ser- 
vices for youth/adults facing em- 
ployment barriers. 

■ Development of coordination criteria 
involving all relevant agencies. 

« Requirement that single Compre- 
hensive IfVork/orce Preparation 
Agreement be developed for each 
service area Involving vision and 
measurable goals and objectives. 

a Development of multi-agency, state- 
wide School-to-Work Transition Sys- 
tem. 



Iowa 

Previous Accomplishments 



Establishment of subcouncil to define 
broad occupational clusters and skill 
standards applicable across Indus- 
tries. 

Development of educational guaran- 
tees for statewide community college 
system. 

Development of Inventory of Ac- 
countability Measures containing 35 
measures for judging students’ out- 
comes. 

Development of operational frame- 
work for using performance mea- 
sures/standards and evaluation strat- 
egies within a continous program 
improvement system for secondary 
and postsecondary vocational educa- 
tion programs. 

Development of employment/earn- 
ings measures for using Ul data to 
judge program performance. 
Development of automated system 
for tracking pre/post information on 
employment, earnings, Ul receipt and 
job retention for all participants in 
state’s workforce preparation pro- 
grams. 

Establishment of state/local partner- 
ship to achieve State Goals for 
Learning. 

Agreement on twelve outcomes and 
their measures, for use in improving 
workforce preparation activities. 



Creation of Target Alliance estab- 
lished by governor and representing 
six state agencies, to study the 
workforce preparation system & de- 
velop a theme and general Ideas for 
achieving a more Integrated system: 
♦Theme: greater attention to “hori- 
zontal systemic connections" be- 
tween programs and organizations 
to support local efforts to cross or- 
ganizational territories in providing 
services. 

♦ Ideas: 

□ Consideration of establishing an 
overall workforce development 
council representing all programs. 



□ Stimulation of efforts to influence 
laws and regulations inhibiting col- 
laboration and coordination. 

□ Implementation of a collaborative 
process to develop a comprehen- 
sive State Human Investment Poli- 
cy and appointment of a Work- 
force Development Coordinator. 

Development of funds for local work- 
force development centers. 
Development of outcome-based 
SchooI-to-Work fowa Transition model. 
Creadon of Council on Human Invest- 
ment Xo set long-term human invest- 
ment goals and benchmarks, and to 
conduct customer satisfaction surveys. 



Identification of models for support- 
ing continuous program improve- 
ment. 

Identification of models for develop- 
ing system-wide definitions, mea- 
sures, and incentives/sanctions. 
Development of strategies for ob- 
taining better data sources, coordi- 
nating automated data systems and 
networks, and sharing data. 
Identification of strategies for as- 
sessing program participants’ skills 
across different assessment instru- 
ments. 

Development of performance mea- 
sures for use at the local level con- 
sistent with state measures. 



Technical Assistance Requested 



Development of benchmarking 
process. 

identification of “best practices” in 
developing quantitative measures 
consistent with benchmarks. 
Consideration of fund search 
strategies. 

Development of strategies and 
methods for studying processes and 
outcomes re: continuous program 
Improvement. 

Identification of performance 
measures used at federal level and 
by other states. 

Figure 2 m Continued 
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Figure 2 >> Continiii^j^ 



NswYork 

Previous Accomplishments 



Governor’s Plan for Coordination of 
Workforce Development and NYS 
Strategy for Workforce Excellence 
support a comprehensive customer- 
oriented service system, skilled 
workforce and high quality services. 
Concepts involved are: 

♦ Development of measurable out- 
comes for entire workforce system. 

♦ Redesign of education/training sys- 
tem. 

♦ Enhancement of job development/ 
placement. 

W^orfcforce Preparation Evaluation 
Act requires state agencies respon- 
sible for administering workforce 
preparation programs to prepare an- 
nual program plans, Identify funding 
sources, and report actual program 
outcomes agairtst stated program 
goals and objectives. 

Educational community's New Com- 
pact for Learning emphasizes prepa- 
ration for meaningful work, sets 
learning standards, and recom- 



North Carolina 
Previous Accomplishments 



mends assessment methods for as- 
suring continuous program Improve- 
ment. 

ACCESS program provides compre- 
hensive educational and training/re- 
training services via one site using a 
common Client Assessment Frame- 
work, 

GATEWAY Initiative increases coor- 
dination of goals/objectives across 
workforce preparation programs and 
creates network of coordinated ser- 
vices in 24 sites, and provides infor- 
mation about 'best practices' In inte- 
grating customer services. 

I Career Pathways School-to-Work 
Opportunities Initiatives test an inte- 
gration of workforce preparation with 
academic education. 

I Education for Gainful Employment le- 
verages additional JOBS funds to ex- 
pand the range of options for AFDC 
clients regarding educational and 
training alternatives. 



Governor's Commission on Work- 
force Preparedness is responsible 
for creating a coherent, comprehen- 
sive workforce development system 
with common vision and goals 
across all relevant programs. Is ex- 
pected to develop a 4-year strategic 
plan and a 2-year plan which in- 
cludes state workforce goals and ob- 
jectives. The Commission has a 
number of task forces that are re- 
sponsible for different dimensions of 
the workforce system: 

♦ School-to-Work Task Force Is Im- 
plementing statewide business/ed- 
ucation Initiative, JobReady, to cre- 
ate a schooi-to-work system, 
including development of outcome 
strategies such as certificates of 
mastery and competency mea- 
sures — with assistance from the 
University of Maryland's Center for 
Learning and Competitiveness. 



Technical Assistance Requested 



Identification of sources of Informa- 
tioti for reducing barriers to the de- 
velopment and use of common out- 
come definitions and definitions of 
core competencies. 

Identification of 'best practices' In 
other states. 

Assistance with waiver requests. 



^Literacy Task Force is developing 
strategic state plan for increasing 
adult literacy, with assistance from 
the Corporation for Enterprise De- 
velopment. 

^ High Performance Task Force has 
produced report on characteristics 
of high performance firms, assisted 
by a national consultant. 

♦ Welfare Reform Task Force is de- 
veloping a customer and outcome- 
focused strategic plan for reforming 
the state welfare system. 

I Interagency Coordinating Council 
provides technical advice to the 
Commission on policy, needs, Infor- 
mation sharing and continuous pro- 
gram improvement. Has developed a 
model for a comprehensive workforce 
preparation system, Virtual Work- 
force Preparedness Paradigm, 



Technical Assistance Requested 



Development of statewide goals and 
standards and program- level stan- 
dards, and the design of system- 
wide information systems to track 
achievement. 

Development of quality criteria for 
self-assessment and other evalua- 
tive purposes. 
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North Carolina 
Previous Accomplishments 



Commission on Standards and Ac- 
countabiiity is setting new standards 
and skill measures (or public school 
system. 

Commission fora Competitive North 
Carolina is developing four-year stra- 
tegic plan for economic development, 
a performance-based budgeting 
strategy, and a plan for increasing 



Toxaa 

Previous Accomplishments 



■ The Texas Council on 'Workforce 
and Economic Competitiveness (an 
HRIC and a separate state agency) 
was established to unify policy de- 
velopment, planning and evaluation 
of workforce development efforts. 
The Council Is responsible for devel- 
oping a strategic state plan which 
ties funding to performance and in- 
cludes goals, objectives and perfor- 
mance measures for all workforce 
development programs. 

The Council has an Evaluation and 
Performance Committee and a num- 
ber of workgroups under it. Purpos- 
es of the Council are to: 

♦ Develop Industry-based skills stan- 
dards/certlflcation system. 

♦ Develop comprehensive labor mar- 
ket Information system. 

♦ Design school-to-work transition 
process. 

♦ Create local workforce boards and 
service centers. 

♦ Develop statewide system for eval- 
uating the effectiveness and effi- 
ciency of all workforce develop- 
ment programs. 

Texas Tomorrow is the current stra- 
tegic plan for the workforce prepara- 
tion system, developed by the Coun- 
cil. Goals and objectives include: 

♦ Consolidation of workforce devel- 
opment boards and creation of 
one-stop centers at local level. 



the application of Total quality man- 
agement throughout state govern- 
ment. 

North Carolina has also developed a 
preliminary set of categories for out- 
come and performance standards, 
and actual measures and standards 
within this categories, across the en- 
tire system. 



♦ Development of uniform state-wide 
client application and eligibility de- 
termination system for major work- 
force development programs. 

♦ Development of intake/assessment 
process that can distinguish be- 
tween those for whom education 
and training are appropriate vs. 
those for whom basic labor market 
information, job search assistance 
and placement are appropriate. 

♦ Development of state/local strategic 
planning, evaluating and account- 
ability system to enable the state to 
assess results achieved and '^return 
on investment", and to improve the 
quality of programs and their deliv- 
ery systems. 

♦ Improvement In individuals’ literacy, 
basic education and basic work- 
place skills, including the proportion 
completing secondary and post- 
secondary programs. 

♦ Adoption of standard definitions and 
levels of achievement of workplace 
basic skills, and incorporation of 
these standards into education and 
training programs. 

♦ Preparation of youth for meaningful 
work and life-long learning. 

Current strategic plan has two parts: 
the first is on vision, philosophy, mis- 
sion, system goals, and program 
goals and objectives under each 
goal, and has been completed; the 
second is on core performance mea- 
sures which Is in process. 



Technical Assistance Requested 



Technical Assistance Requested 



Quality improvement process. 
Data system models. 
Integration of adult education. 
Waivers. 
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T«xas 

Pnvious Accomplishments 



Related efforts: 

«. Workforce Deve/opmenf Initiative 
for ybuf/j is the T exas school-to- 
work prefect and will include per- 
formance standards. 

* The New Texas Prosperity is a gu- 
bernatorial economic development 
effort. 

♦ The Smart Jobs Plan Is a compre- 
hensive governor-sponsored strat- 
egy to develop high-wage, hlgh- 



Waehlnsten 

Previous Accomplishments 



Investment In Human Capital study 
Identified empioyer/employee needs 
and organizational barriers In state's 
workforce development programs 
and evaluated the performance of 
these programs. It established a 
standard for how workforce systems, 
as well as programs, could be evalu- 
ated sdentifically. Major recommen- 
dations from the study were: 

* Improve coordination. 

♦ Increase accountabiiity. 

* Create a state coordinating board 
for workforce education and train- 
ing. 

Creation of the Washington State 
Education and Training Coordinating 
Board (WETCB) by the Washington 
State Legislature, to be appointed by 
the governor. This board is responsi- 
ble for designing an accountability 
system for workforce education, 
training and employment, as well as 
for policy development, planning and 
coordination re: a customer-driven 
system. Its vision and mission are: 
♦Vision: “to develop a globally com- 
petitive workforce supported by an 
accessible, flexible, competency- 
based and technologically current 
education and training system”. 

♦ Mission: 

□To establish new workforce part- 
nership among labor, business, 
education and government. 

□To Improve interprogram coordi- 
nation. 



skill jobs and produce a quality 
workforce through coordinating ed- 
ucation and training. 

♦ The Texas Assessment of Academ- 
ic Skiils involves quantifiable educa- 
tional objectives. 

♦ Texas community colleges now op- 
erate within performance standards. 



Technical Assistance Requested 



□To promote competency-based 
education and training with equal 
emphasis on acquisition of aca- 
demic and occupational skills. 

□ To leverage and generate addi- 
tional resources for an Integrated 
state-wide education and training 
system. 

■ Washington's role in the National 
Conference of State Legislature's 
Jobs for the Future project: one of 
five states involved, focusing on 
school-to-work transition, skills up- 
grading, and coordination of work- 
force system. 

■ Washington’s now Performance Part- 
nership: brings governor, legislature, 
state employees and private sector 
together to create a performance 
management system for all elements 
of state government. Will focus on 
the development of measurable out- 
comes and continuous program im- 
provement. 

B WETCB's state workforce develop- 
ment plan: establishes benchmarks 
and measurable goals and objectives 
for workforce preparation system. 

♦ The Board has developed prelimi- 
nary Targets for Excellence for the 
workforce system. Utilizing the NQA 
project, it has continued its analysis 
of Issues surrounding the develop- 
ment of measurable system goals 
and performance standards, and 
the coordination of information sys- 
tems. 



Technical Assistance Requested 



■ Information about ‘best practices' in 
other states. 

B Identification of competent consult- 
ants. 

B Federal waivers. 

B Federal developments relevant to 
workforce deyelopment systems. 
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Washington 

Previous Accomplishments 



♦ Accountability section within the 
new state workforce plan Is consis- 
tent with Board's accountability 
mandate! 

o Assessment of state education 
and training needs. 

□ Establishment of an inventory of 
programs. 

□ Evaluation of the outcomes of the 
workforce system. 

n Development of minimum stan- 
dards for data collection and pro- 
gram evaluation. 

□ Development of reliable, valid and 
accessible data base for the sys- 
tem. 

Accountability section recommends 
the following: 

♦ A number of scientific surveys: 

□A state-wide household survey 

and data match with U1 data every 



six years on a range of issues re < 
iated to workforce preparation. 

□ A survey of employers every six 
years. 

□ Surveys (and focus groups) to de- 
termine customer satisfaction ev- 
ery two years. 

□ Periodic conducting of a compre- 
hensive process and Impact study 
of programs within the workforce 
system: a process study of inter- 
program coordination, private sec- 
tor participation and other Issues 
of Interest; a net Impact and cost/ 
benefit study of major new pro- 
grams. 

♦ Matching of participants’ program 
outcomes at approximately nine 
months and at five years beyond 
program participation, with Ul data 
to determine earnings and obtain 
other information. 



Technical Assistance Requested 
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Measurable Goals, 
Ob{ec^lves, and Outcomes 



llllnoia 

Will develop common set of measur- 
able outcomes for each group, as 
well as standards for ea^, which 
apply across all programs. 



Monitoring and Evaluation 



Organizational Arrangements 



Will develop alternative models for 
achieving continuous program im- 
provement, and make recommenda- 
tions. 



Governor’s Tssk Force on Human 
Resource Development Is mandated 
to shape Integrated, performance- 
driven human resource system, so will 
provide the leadership re: NGA 
project. Updates, focus groups, public 
hearings, artidies in agency newslet- 
ters will be used to update all relevant 
agendas, employers, public. 



Iowa 

Will develop policy goals for work- 
force preparation system, and 
benchmarks for achieving them for 
each population group, with the as- 
sistance of a formal Research 
Group from throe state universities. 
Will develop common performance 
measures and definitions for each 
population group, to be used at both 
the state level and at the level of lo- 
cal workforce centers. 



a Will develop a common performance 
management system for all programs. 

■ Will develop a method for monitoring 
and judging performance across sys- 
tem, including customer satisfaction 
and service quality. 

K Will develop measures to assist ser- 
vice providers in implementing con- 
tinuous program improvement. 

■ Will develop self-assessment tools. 

■ Will develop an integrated automated 
information system to support inter- 
agency efforts. 

a Will seek to identity ‘best practices.' 



A state Workforce Development 
Council will be created, associated 
with the Human Investment Policy 
Council. Meanwhile an existing inter - 1 
agency policy team will be responsi- 
ble for the project, assisted by a 
Technical Work Group. 

I Service providers, customers, com- 
munities and others will be invested 
In the process through symposia 
and other forums and through a 
Special Communications Group. 



N«w York 

Will Identify system-wide bench- 
marks for each population group us- 
ing outcome-based measures and 
process (quality) standards, and re- 
lying on skills assessment/certifica- 
tion system to be developed by Na- 
tional Skills Standards Board under 
Goals 2000. 

Will develop MIS to collect, store, 
and analyze outcome data (also U! 
data). 

Will study barriers to Implementing a 
comprehensive performance man- 
agement system. 

Will develop strategic plan for work- 
force preparation system specifying 
goals, benchmarks, objectives, mea- 
surable outcomes, and Information 
system, drawing on US DOL’s Core 
Data Elements and Common Defini- 
tions . 

1 Will design pilot project to test viabil- 
ity of concepts In the state plan. 



Will use Evaluation Act to support de- 
velopment of common set of outcomes 
and strategies for continuous program 
improvement. 

■ Will seek to pinpoint “best practices.** 

■ Will develop a “feedback loop" to in- 
crease utilization of program/UI data 
for continuing program improvement. 

0 Will develop economic Incentives and 
sanctions to support the use of analy- 
ses to improve outcomes. 



NY State Job Training Coordinating 
Council will coordinate existing state 
workforce agencies, councils and re- 
lated organizations via a new project 
team. 



Figure 3 ■ Continued | 
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Measurable Goals, 
ObjectSves, and Outcomes 



Monitoring and Evaluation 



North Carolintt 

Will develop and define quantifiable 
state goals for each client group 
across entire workforce preparation 
system. 

Will Identify both outcome-based 
measures, definitions and stan- 
dards, and measures and definitions 
for assessing service delivery and 
service quality for diverse clients. 
Will develop common set of perfor- 
mance standards for all programs In 
workforce system. 

Will rely on Secretary's Commission 
on Necessary Skills and Goals 2000 
In defining basic skills and compe- 
tencies. 

Will recommend changes In legisla- 
tion and regulation re: waivers. 



Organizational Arrangements 



Texas 

Will refine performance measures 
for state plan goals and objectives. 
Will use the eight core performance 
measures developed In collaborative 
process by Texas Council on Work- 
force and Economic Competitiveness 
as general framework for NGA project. 
Will view development and implemen- 
tation of performance management 
system as six-year project involving: 

♦ Creation of inventory of current in- 
formation systems and consider- 
ation of ways to connect them. 

♦ Development of plan for coordinat- 
ing information systems. 

♦ Reduction of barriers to coordina- 
tion/integration at all levels. 

^ Formation of workgroups to devel- 
op Implementation strategies. 



■ Will focus on a number of elements 
of a quality assurance system, such 
as continuous program improvement, 
program accreditation, and capacity 
building. 

« Will develop methods for tracking 
system progress in meeting state 
goals. 



Governors' Commission on Work- 
force Preparedness (NC’s HIRC) will 
have ultimate responsibility, but an 
expanded Interagency Coordinating 
Council will oversee NGA project. 



Will link performance management 
system with system-wide continuous 
program improvement and quality as- 
surance systems. 

Will develop evaluation process for 
continuous program improvement 
and quality service delivery. 



Texas Council's Evaluation and Per- 
formance Committee will oversee 
NGA project. 

Committee's Performance Measure- 
ment Workgroup will serve as inter- 
agency policy group. 
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Measurable Goals, 
Objectives, and Outcomes 



Washington 

Will establish benchmarks and mea- 
surable goals* objectives, outcomes, 
and performance standards. 

♦ Will further refine Targets for Ex- 
cellence. 

♦Will consider more thoroughly the 
pros and cons of using perfor- 
mance standards. 

Data system coordination/intogra- 
tion: efforts will be focused on a 
more coordinated and Integrated 
workforce development information 
system, emphasizing: 

♦ Common set of data elements and 
definitions. 

♦ Common reporting requirements. 

♦ Participant confidentiality protec- 
tions. 

♦ Reduction of data duplication. 

♦ Information portability. 

♦ Staff training needs. 

♦ State-of-the-art computer hardware 
and software needed. 



Monitoring and Evaluation 



Will further develop and refine evalu- 
ation system forjudging both the 
workforce system's and Its programs* 
progress against goals and objec- 
tives based on scientific principles 
and methods. 

I Accountability section of new state 
workforce development plan will 
serve as framework for further devel- 
opment and refinement of methods 
for ensuring accountability. Special 
consideration will be given to: 

♦ Using skills standards and compe- 
tency-based assessments as part of 
system-wide and program-specific 
evaluations. 

♦ Using program evaluations to sup- 
port continuous program improve- 
ment and quality assurance. 

♦ Developing reports for customers of 
the workforce system (workers, em- 
ployers and other stakeholders) to 
increase informed choice among 
education, training, and employ- 
ment options. 



Organizational Arrangements 



WETCB Is coordinating the NGA 
project. Its established Interagency 
Committee will play a major role, 
and a representative of governor's 
office will link project with state's 
new Performance Partnership. A 
technical workgroup on accountability 
will have operational responsibility. 






139 



o 



Evaluation Forum • Issue 11 • Summer 1Q95 



148 






Evaluation issues and Activities ■ At tha State and Local Laval 




goals, and more specific objectives. 
Accountability efforts were to focus on 
retooling the existing workforce, pre- 
paring the emerging workforce, and 
building the workforce infrastruc- 
ture — and on performance-based bud- 
geting in the areas of social and eco- 
nomic well-being, corrections, health 
and safety, economic development, the 
environment, justice, education, agri- 
culture, cultural resources, and general 
government. Measurable objectives 
were being developed for each area of 
interest, as well as outcome measures 
consistent with policy goals. Of partic- 
ular concern were the quality of jobs, 
employment retention, and poverty re- 
duction. Additional attention was being 
given to strategies for strengthening 
political support and marketing the sys- 
tem. 

The Texas report focused on desired 
system outcomes and quantitative mea- 
sure for identifying them, based on five 
major system goals and a set of objec- 
tives imder erch. The goals emphasized 
1) the development of a statewide sys- 
tem supporting local workforce devel- 
opment centers and providing a net- 
work of services and information to 
customers, 2) the creation of a state/lo- 
cal strategic plamiing and evaluation 
subsystem forjudging the performance 
of the system, 3) the acquisition of 
literacy, basic education and basic 
workplace skills by customers, 4) the 
acquisition of occupational skills by 
customers that meet workplace require- 
ments for long-term sustaining employ- 
ment in high-skill, high- wage occupa- 
tional areas, and 5) the preparation of 
youth through obtaining knowledge, 
skills and behaviors necessary for the 
transition to high-skill, high-wage car- 
rers and through lifelong learning. De- 
sired outcomes included labor market, 
learning, customer satisfaction, and 
system equity outcomes. 

Washington explained the state’s 
performance management framework 
in its report, as well as describing sys- 
tem policy goals and outcomes. This 
framework emphasized the intercon- 
nections among components of the 
workforce system: state-wide policy 
goals, measurable outcomes, the data 
system infrastructure, the outcomes of 



programs within the system, and the 
utilization of evaluation results for con- 
tinuous quality improvement. The poli- 
cy outcomes focused on employment, 
earnings, skill competencies, worker 
productivity, the reduction of poverty, 
customer satisfaction, and the system’s 
general return on the public’s invest- 
ment. The Washington report advocat- 
ed the use of multiple measures for 
each of the major desired outcomes, to 
increase the precision and validity of 
outcome evaluations. 

Some Comments on 
the NGA Project 

A number of issues are involved in 
the six states’ efforts to develop an ab- 
stract system concept, and to describe 
its potential implementation. Among 
them are these: 

■ How' do planners move logically and 
realistically from abstract missions, 
benchmarks and goals, to more spe- 
cific objectives and measurable out- 
comes? 

■ Must all the outcomes be measur- 
able quantitatively? 

■ How should “continuous improve- 
ment” and “quality assurance” be 
defined, in order for planners to re- 
alistically monitor and evaluate 
these attributes of systems? 

■ How much should be expected, 
pragmatically, of govemment/pri- 
vate sector partnerships in achieving 
the more idealistic visions of work- 
force systems promoted by the kind 
of system planning efforts encour- 
aged in the NGA project? 

■ Should new workforce systems be 
permitted to function for a time be- 
fore crystallizing the outcomes to be 
expected of them, and developing 
performance standards? 

Although many such questions can 
emerge from these impressive planning 
activities in states, the NGA project is 
particularly important in the context of 
the renewed political interest in budget 
balancing, greater state-level discretion, 
and the consolidation of programs and 
service delivery. The movement to de- 
velop state-wide workforce systems un- 



der over-arching state boards or coun- 
cils predated this shift, however. This 
movement was encouraged by the 
evolving positions of national employ- 
ment and training organizations and 
governors, and by incentives from the 
U.S. Department of Labrr as part of 
Secretary Reich’s effor- move the 
employment and training system from a 
largely-fragmented unemployment sys- 
tem to a more collaborative and inte- 
grated reemployment system. 

Motivated and funded quite differ- 
ently by these disparate supporters of 
state- wide workforce initiatives, a com- 
mon trend toward state authority and 
innovation in employment and training 
(with or without substantial federal 
oversight) has come to pass. The NGA 
project has demonstrated what states 
can accomplish on their own, with spe- 
cial assistance from national experts, 
not only in developing workforce sys- 
tems but in evaluating them using com- 
petent social science principles and 
methods. 



Editor’s Note 



The NGA references for this article 
are listed below. They were working pa- 
pers provided to participants of the Per- 
formance Management Project in June 
and July of 1994. 

Developing Comprehensive Perfor- 
mance Management for the Work- 
force System: Project Description. 

Glossary of Project Terms. 

Issues in Developing Comprehensive 
Performance Management for Work- 
force Development Systems. 

Texas's Process for Setting Core Per- 
formance Measures. 

Attachment C of the report prepared 
by the Texas Council on Workforce and 
Economic Competitiveness summariz- 
ing the results of a survey of national 
performance management specialists. 
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States have long recognized that 
sotrse workforce development policies 
and procedures have b^n oonflictirig or 
Incompatible. This they knew was dam- 
aging service KJ,uailty, preduding Inter- 
agency «r!(aboration, and reducing the 
ability of participants to move Into and 
between programs. Simultaneously, 
states were appreciating the importance 
of encouraging the development of 
hlgh-skili, high-wage workforces, which 
would demand a reorganization of the 
workforce system. 

To puii education and sklli training 
together batter, many states introduced 
oducationai reforms in the 1990s to 
achieve a batter linkage between aca- 
demic knovrlsdge and workforce skills, 
stimulated by the National Education 
Goals established by the President and 
the governors in 1989. Some states cre- 
ated new state boards or councils re- 
sponsibio for the full gamut of workforce 
programs and special projects. Some 
were moving toward coordinated, some- 
times integrated, information systems 
that would support these new statewide 
systems and their evaluation. 

The JTPA amendments spawned 
some of these human resource boards. 
Reflecting Congressional interest in co- 
ordination, these amendments promot- 



ed program and service delivery coordi- 
nation under the aegis of broadly repre- 
sentative state-wide boards or councils 
whoso rasponsibilily was to set policy, 
develop short and longer- term plans, 
promote coordination, and establish ac- 
countability for all state workforce-relat- 
ed programs and services. These enti- 
ties were bssomlng the major tool for 
seeking better integration while reduc- 
ing costs and making programs more 
accountabie for adrievlng broad, cross- 
cutting goals. 

The emphasis was now on state 
wciidorce systems, rather than on an 
increasingly unwieldy colleetiorj of pro- 
grams vtfith diverse goals and regula- 
tions. Tliese systems were to involve 
clear-cut benchmarks, goals, objertives 
and performance indicators. Locating 
these tasks at the state level supported 
the decentralization of authority and re- 
sporrsibility laurrehed in the 1 980s. 

Such dscentrailzation was to permit 
the federal government to restructure It- 
self, and later to “reinvent* itself, as a 
leaner, more coordinated, and more 
etiiciant body. 

Decentralization has meant, howev- 
er, that states have had few national 
models or guidelines to assist them in 
pursuing workforce integration. Apart 
from their own efforts to share informa- 
tion with other states and learn from 



their approaches, only minimal ted^ini- 
cai assistance has beer, avaliable. 
Therefore, eacdi state's strategy for 
workforce coordination has been some- 
what idiosyncratic, beyond th© necessi- 
ty to respond to state-specafic needs 
and interests. And accurate, detailed tn- 
fomnetlon on the nature and status of 
workforce coordination efforts across 
diverse states has been hard to con^s 
by. Only time-iimitad, selective ‘snap- 
shots* were available, which artifidrily 
froze states’ activities for a moment, ac- 
tivities that wars an important part of an 
evolutionary process 'hat was constant- 
ly clianging. 

In the midst of continuirig experi- 
mentation with coordination strategies, 
there has been a strong steady move- 
ment to ensure ttie “accountability* of 
new more comprehensive and Integrat- 
ed workforce development systems. 
The methods for establishing such ac- 
countability have moved ever doser to 
evaluation reseatch standards. The 
NGA project is an example of this com- 
mitment to peaking professional Judg- 
ments of the results of system policies 
and activities, and the impact of system 
interventions for workers and employ- 
ers. Obtaining such objective results is 
now an accepted input to comprehen- 
sive workforce policy development and 
planning. 
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In the first part of this section of 
Evaluation Forum we sample referenc- 
68 from the plethora of publications on 
economic change, restructuring and 
worker dislocation. The list of useful 
books, articies, reports and profession- 
al papers Is loosely separated Into 
three categories: publications focusing 



mainly on U.S.- specific issues; publica- 
tions providing insights about other 
countries: and a special bibliography on 
workforce development coordination is- 
sues. We have indicated with a single 
asterisk (*) the publications in the first 
two categories which deal mainly with 
gsnsral economic issues, as a context 
for learning more about the context of 
worker dislocation, and indicated with a 



double asterisk (•*) those that deal 
more directly wl^ worker dislocation 
end displacement 

The second part of the Resources 
Section updates readers regarding 
some of the federal research conducted 
since the last issue of the journal. This 
Is a limited overview, based on the re- 
sponses of relevant federal agendas to 
the editor’s request for Information. 



References on Economic Change, 
Restructuring and Worker Dislocation 



Information about 
the United States 

♦Abraham, K. and S. Houseman. Job 
Security in America: Lessons from 
Germany. Washington, D.C.: The 
Brookings Institution, 1993. 

♦Abraham, K. and L. Kati. “Cyclical 
Unemployment; Sectoral Shifts or 
Aggregate Disturbances?” in Jb«r-- 
nai of Political Economy, 94, 1986. 

♦*Aho, C. and J. Orr. “Trade-Sensitive 
Employment: Who Are the Affected 
Workers?" in Monthly Labor Review 
104,1981. ^ 

■♦♦American Management Association: 

1 993 Purvey on Downsizing and As- 
sistance to Displaced Workers. New 
York, 1993. 

*Ashenfelter, O. “Estimating the Ef- 
fects of Training Programs on Earn- 
ings," in Review of Economics and 
Statistics, 60, 1978. 

■♦♦Bailey, T. “Changes in the Nature 
and Structure of Work: Implications 
for Skills and Skill Formation.” Re- 
port of the Conservation of Human 
Resources. New York, NY: Colum- 
bia University, November 1989. 



♦♦Baily, M. “Wages and Employment 
Under Uncertain Demand” in Re- 
view of Economics and Statistics, 
41, 1974. 

♦Baily, M. and A. Chakrabarti. Innova- 
tion. and the Productivity Crisis. 
Washington, D.C.: The Brookings 
Institution, 1988. 

♦♦Balderson, K. M. Plant Closings, 
Layoffs, and Worker Readjustment. 
Washington, D.C.: National Gover- 
nors’ Association, 1986. 

♦♦Baldwin, S. Technology and Em- 
ployment Policy. Washington, D.C.: 
National Commission for Employ- 
ment Policy, 1987. 

* *Barton, P. A Belter Fit Between Un- 
employment Insurance and Retrain- 
ing. Washington, D.C.: National In- 
stitute for Work and Learning, 1986. 

♦Bamow, B. The Education, Training 
and Work Experience of the Adult 
Labor Force from 1984 to 1995, 
Washington, D.C.: National Com- 
mission for Employment Policy, 
1985. 



♦Becker, G. “Investment in Human 
Capital: A Theoretical Analysis” in 
Journal of Political Economy, 70, 
1962. 

♦♦Bednarzik, R. and M. Lovell. U.S. 
Labor Market Adjustment Pro- 
grams. Paper prepared for the Presi- 
dent’s Competitiveness Policy 
Council, 1991. 

♦♦Bednarzik, R. Trade-Sensitive U.S. 
Industries: Employment Trends and 
Worker Characteristics. Washing- 
ton, D.C.: Bureau of International 
Labor Affairs, U.S. Department of 
Labor, 1991. 

♦♦Bendick, M. The Role of Public Pro- 
grams and Private Markets in Reem- 
ploying Workers Dislocated by Eco- 
nomic Change. Washington, D.C.: 
The Urban Institute, 1982. 

♦♦Benus, J. and R, Byrnes' The St. 
Louis Metropolitan Reemployment 
Project: An Impact Evaluation. 
Washington, D.C.: U.S. Department 
of Labor, 1991, 



142 











1 



o 



151 



Evaluation Forum , Issue 11 . SumtnarlOOB 









Resources . References on Economic Chango. Restaicturing and Worker DLsjgca^ 



**Benson, D. Worlrforce Development: 

A Survey of Ohio Employers. Co- 
lumbus, OH: Appropriate Solutions, 
1993. 

*Blackbum, M. and D. Bloom. The Ef- 
fects of Technological Change on 
the U.S. Distribution of Earnings 
and Income. Paper for Panel on 
Technology and Employment, 1987. 

♦♦Blalock, A.B. “Analyzing Worker 
Displacement in the 1980s: The 
Landmark Reports of the Office of 
Technology Assessment,” in Evalu- 
ation Forum, Issue #7, Summer 
1992. 

♦Blinder, A. Paying for Productivity: A 
Look at the Evidence. Washington, 
D.C.: The Brookings Institution, 
1990. 

♦Bloom, H. Estimating the Long-Run 
Effects of Job Training Using Longi- 
tudinal Earnings Data. Cambridge, 
MA: John F. Kennedy School of 
Government, Harvard University, 
1982. 

Back to Work: Testing Re- 



employment Services for Displaced 
Workers. Kalamazoo, MI; W.E. Up- 
john Institute for Employment Re- 
search, 1990. 

*Bluestone,B. and B. Harrison. The 
Great Amefican Job Machine: The 
Proliferation of Low Wage Employ- 
ment in the U.S. Economy. Paper for 
Joint Economic Committee, U.S. 
Congress, 1986. 

♦ The Deindustrialization 

of America: Plant Closings, Com- 
munity Abandonment, and the Dis- 
mantling of Basic Industries. New 
York, NY: Basic Books, 1982. 

♦Boyd, W. and C. Kerchner (Editors). 
The Politics of Excellence and 
Choice in Education. New York, 
NY: Palmer Press, 1988. 

♦Brock, W. and R. Hormat. (Editors) 
The Global Economy: America 's 
Role in the Decade Ahead. New 
York, NY: W.W. Norton, 1990. 



♦Brooks, H. and L. Schneider. Poten- 
tial Impact of New Manufacturing 
Technology on Employment and 
Work in Industrial and Developing 
Countries. Policy paper. Cambridge, 
MA: John F. Kennedy School of 
Government, Harvard University, 

1985. 

♦♦Bruno, L. Operating Effective Reem- 
ployment Strategies for Displaced 
Workers. Paper for U.S. Department 
of Labor by CRS Incorporated, 

1986. 

♦Camevale, A. America and the New 
■ Economy. Washington, D.C.: Amer- 
ican Society for Training and Devel- 
opment and the U.S. Department of 
Labor, 1991. 

♦Camevale, A. and H. Goldstein. Em- 
ployee Training: Its Changing Role 
and An Analysis of New Data. 
Washington, D.C.: American Soci- 
ety for Training and Development, 
1986. 

♦Chinloy, P.T. and E. W. Stromsdorfer 
(Editors) Labor Market Adjustments 
in the Pacific Basin. Boston, MA: 
Klewer-Niuhoff, 1987. 

♦Chubb, J. and R. Moe. Politics, Mar- 
kets and America 's Schools. Wash- 
ington, D.C.: The Brookings Institu- 
tion, 1990. 

♦Cole, R. Work, Mobility, and Partici- 
pation. Berkeley, CA: University of 
California Press, 1979. 

♦Committee for Economic Develop- 
ment: An America That Works: The 
Life-Cycle Approach to a Competi- 
tive Workforce, 1990. 

♦♦Cook, R. “Insights Concerning Suc- 
cessful Strategies in Dislocated 
Worker Projects,” in Evaluation Fo- 
rum, Issue #2. 

♦♦Corson, W. et al. An Impact Evalua- 
tion of the Buffalo Dislocated Work- 
er Demonstration Program. Prince- 
ton, NJ: Mathematica Policy 
Research, Inc., 1985. 






The New Jersey Unem- 
ployment Insurance Reemployment 
Demonstration Project. Washing- 
ton, D.C.: U.S. Department of La- 
bor, 1989. 

_ Process and Imple- 



mentation Issues in the Design and 
Conduct of Programs to Aid the Re- 
employment of Dislocated Workers. 
Princeton, NJ: Mathematica Policy 
Research, Inc., 1984. 

* ♦ International Trade 



and Worker Dislocation: Evaluation 
of the Trade Adjustment Assistance 
Program. Princeton, NJ: Mathemati- 
ca Policy Research, Inc., 1993. 

♦♦Creticos, P.A. and R.G. Sheets, Eval- 
uating State-Financed Workplace- 
Based Retraining Programs. Wash- 
ington, D.C.: National Commission 
for Employment Policy and the Na- 
tional Governors’ Association, 

1992. 

♦Cyert, R. and J. March. A Behavioral 
Theory of the Firm. Englewood 
Cliffs, NJ: Prentice-Hall, 1963. 

♦Dertouzos, M., R. Lester and R. So- 
low. Made in America: Regaining 
the Productive Edge. Cambridge, 
MA: MIT Press, 1989. 

♦Duncan, G. et al. Private Lives and 
Public Policies: Confidentiality and 
Accessibility of Government Statis- 
tics. A report by the Panel on Confi- 
dentiality and Data Access. National 
Research Council. Washington, 
D.C.: National Academy Press, 

1993. 

♦Edwards, R. Rights At Work: Employ- 
ment Relations in the Post-Union 
Era. Washington, D.C.: The Brook- 
ings Institution, 1993. 

♦Ehrenberg, R. Labor Markets and In- 
tegrating National Economies. 
Washington, D.C.: The Brookings 
Institution, 1995. 









. 

ERIC 



Bv&Mlott Forum # l$$ud 11 • Summer 1QQS 



152 



143 






*‘^Fechter, A. Forecasting the Impact 
of Technological Change on Man- 
power Utilization and Displacement 
Working paper. Washington, D.C.: 
The Urban Institute, 1974. 

**Fedrau, R. H. “Responses to Plant 
Closures and Major Reductions in 
Force: Private Sector and Communi- 
ty-Based Models,” in tQ Annals of 
the American Academy of Political 
and Social Science, 475, 1984. 

**F!aim, P. and E. Sehgal. “Displaced 
Workers of 1979-1983: How Well 
Have They Fared?” in Monthly La- 
bor Review 108, 1985. 

^Fretwell, D. et al. Employment Dimen- 
sions of Economic Restructuring: A 
Review of Related Labor Policies 
and Programs in Industrialized 
Countries, The World Bank, 1991. 

*Graham, C. Safety Nets, Politics, and 
The Poor, Washington, D.C.: The 
Brookings Institution, 1994. 

*Gui!e, B.R. and H. Brooks. (Editors) 
Technology and Global Industry: 
Companies and Nations in the 
World Economy, Washington, D.C.: 
National Academy Press, 1987. 

**Hall, R. “The Importance of Lifetime 
Jobs in the U.S. Economy” in Amer- 
ican Economic Review, 72, 1982. 

R. and'E. Lazear. “The Excess 
Sensitivity of Layoffs and Quits to 
Demand” in American Fxonomic 
Review, 69, 1984. 

**Hamennesh, D. “The Costs of Work- 
er Displacement,” in Quarterly 
Journal of Economics 102, 1987. 

*Hart, R.(Editor)£wp/oywen/, Unem- 
ployment and Labor Utilization, 
London, U.K.: Unwin Hyman, 1988. 

^Hartman, H. (Editor) Computer Chips 
and Paper Clips: Technology and 
Women 's Employment, Washington, 
D.C.: National Academy Press, 

1987. 



*Hirschhom, L. Beyond Mechaniza- 
tion: Work and Technology in a 
Postindustrial Age, Cambridge, MA: 
MIT Press, 1984. 

♦♦Hollenbeck, K. Dislocated Worker 
Human Capital Depreciation and 
Recovery, Working Paper. Kalama- 
zoo, MI: W.E. Upjohn Institute for 
Employment Research, 1990. 

♦♦Horvath, F. W. “The Pulse of Eco- 
nomic Change: Displaced Workers 
of 1981-1985,” in Monthly Labor 
Review 110, 1987. 

♦Huang, W. (Editor) Organized Labor 
at ike Crossroads, Kalamazoo, MI: 
W.E. Upjohn Institute for Employ- 
ment Research, 1989. 

♦Hunt, H. and T. Hunt. “An Assess- 
ment of Data Sources to Study the 
Employment Effects of Technologi- 
cal Change,” in Technology and Em- 
ployment Effects, report of the Panel 
on Technology and Women *s Em- 
ployment, National Research Coun- 
cil, 1985. 

♦♦Jacobson, L. et al. Earnings Losses 
of Displaced Workers, Working pa- 
per. Kalamazoo, MI: W.E. Upjohn 
Institute for Employment Research, 
1992. 

♦♦Jensen, M. and J. Lederer: Worlforce 
in Transition: A Guide to the Coor- 
dination of State Dislocated Worker 
Sejyices, Washington, D.C.: Center 
for Policy Research, National Gov- 
ernors’ Association, 1992. 

** Johnston, W. and A. Packer. Work- 
force 2000: Work and Workers for 
the Twenty-First Century, Indianap- 
olis, IN: Hudson Institute, 1987. 

♦Kasarda, J. The Regional and U^ ban 
Redistribution of People and Jobs in 
the U,S, Paper for National Research 
Council’s Urban Policy Workshop, 
1986. 



♦Katz, L. and B. Meyer. “Unemploy- 
ment Insurance, Recall Expecta- 
tions, and Unemployment Out- 
comes ” in Quarterly Journal of 
Economics 105, 1990. 

♦Kennedy, P. Preparing for the Twen- 
ty-First Century, New York, NY: 
Random House, 1993. 

♦Kochan, T. and H. Katz. Worker Par- 
ticipation and American Unions: 
Threat or Opportunity? Kalami^zoo, 
MI: W.E. Upjohn Institute for Em- 
ployment Research, 1984. 

♦Kochan, T. et al. The Transformation 
of American Industrial Relations, 
New York, NY: Basic Books, 1987. 

♦♦Kulik, J., D. Smith and E. Stroms- 
dorfer. The Downriver Community 
Conference Economic Readjustment 
Program, Cambridge, MA: Abt As- 
sociates, Inc., 1984. 

♦Krugman, P. The Age of Diminished 
Expectations: U,S, Economic Policy 
in the 1990s, Cambridge, MA: MIT 
Press, 1990. 

♦Lawence, R. “Sectoral Shifts and the 
Size of the Middle Class” in The 
Brookings Review, 3, 1984. 

♦Lawrence, R. et. al. A Vision for the 
World Economy: Openness, Diversi- 
ty and Cohesion, Washington, D.C.: 
The Brookings Institution, 1995. 

♦♦Leigh, D. Retraining Displaced 
Workers: The U.S. Experience. 
Geneva, Switzerland: International 
Labour Organization, 1994. 

Retraining Displaced 

Workers: What Can Developing 
Countries Learn from OECD Na- 
tions? The World Bank, 1992. 

♦Leonard, J. Technological Change 
and the Extent of Frictional and 
Stnxtural Unemployment, Paper for 
Panel on Technology and Employ- 
ment, 1986. 






144 



ERIC, 



153 



-Eva/aaf/on Forum • Issue 11 « Summor 1Q95 



Resources » References on Economic Change. Restructuring and Worker Dislocation 



**Levitan, S. and F. Gallo. A Second 
Chance: Training for Jobs, Kalama- 
zoo, MI: W-E. Upjohn Institute for 
Employment Research, 1990. 

♦Levitan S. and D. Wemeke. Produc- 
tivity: Problems, Prospects, and 
Policies, Kalamazoo, MI: W.E. Up- 
john Institute for Employment Re- 
search, 1984, 

♦Levy, F. Dollars and Dreams: The 
Changing American Income Distri- 
bution, New York, NY: Basic 
Books, 1987. 

♦Lindberg, L. and C. Maier. The Poli- 
tics of Inflation and Economic Stag- 
nation, Washington, D.C.: The 
Brookings Institution, 1985. 

♦Lipset, S.M. Unions in Transition: 
Entering the Second Century, San 
Francisco, CA: Institute for Contem- 
porary Studies, 1986. 

♦Litan, R. et al. (Editors) American 
Living Standards: Threats and 
Challenges, Washington, D.C.: The 
Brookings Institution, 1988. 

♦Magaziner, I. and R. Reich. Minding 
America *s Business, New York, NY: 
Harcourt Brace Jovanovich, 1982. 

♦♦Mangum, S. and J. Tansky. Self Em- 
ployment Training As An Interven- 
tion Strategy for Displaced or Dis- 
advantaged Workers, Management 
and Human Resources Faculty, Ohio 
State University, 1987. 

♦Mincer, J. Schooling, Experience, and 
Earnings, New York, NY: National 
Bureau of Economic Research, 

1974. 

♦Mishel, L. and R. Teixeira. The hfyth 
of the Coming Labor Shortage: 

Jobs, Skills and Incomes of Ameri- 
ca 's Worlforce 2000, Paper of the 
Economic Policy Institute. Washing- 
ton, D.C., 1990. 

♦♦Moore, R. and D. Blake. Does ETP 
Training Work? An Analysis of the 
Economic Outcomes of California 
Employment Training Panel Pro- 
grams, Northridge, CA: California 
State University, 1992. • 



♦♦National Commission for Employ- 
ment Policy: Workers Dislocated by 
Economic Change: Toward New In- 
stitutions for Midcareer Worker 
Transformation, Washington, D.C., 
1982. 

** Displaced Workers: 

New Options for a Changing Econo- 
my, Washington, D.C., 1983. 

♦♦ The Permanence of 

Dislocation: 1979-1983 Evidence, 
Washington, D.C„ 1986. 

♦ ♦ Assisting Dislocated 

Workers, Washington, D.C., 1991. 

♦♦ Upward Mobility Pro- 

grams in the Service Sector for Dis- 
advantaged and Dislocated Work- 
ers, Washington, D.C., 1992. 

♦New York Stock Exchange: U,S, In- 
ternational Competitiveness, 

♦Nothdurft, W.E. Going Global: How 
Europe Helps Small Firms Export, 
Washington, D.C.: The Brookings - 
Institution, 1992. 

♦President’s Commission on Industrial 
Competitiveness: Global Competi- 
tion: The New Reality, Washington, 
D.C.: U.S, Government Printing Of- 
fice, 1985, 

♦♦Podursky, M, and P. Swaim. “Job 
Displacement and Earnings Loss: 
Evidence from the Displaced Work- 
er Survey,” in Industrial and Labor 
Pvelaiions Review, 41, 1987. 

♦Reich, R. Education and the Next 
Economy, Washington, D.C.: Na- 
tional Education Association, 1988. 

* The Work of Nations: 

Preparing Ourselves for 21st Centu- 
ry Capitalism, New York, NY: Vin- 
tage Books, 1992. 

♦Rivlin, A. Reviving the American 
Dream: The Economy, the States, 
and the Federal Government, Wash- 
ington, D.C.: The Brookings Institu- 
tion, 1992. 



♦Rivlin, A. et al. Beyond Alliances: 
Global Security Through Focused 
Partnership, John D. and Catherine 
T. Mac Arthur Foundation and the 
Rockefeller Foundation, 1990. 

♦Robertson, D, B. “Political Conflict 
and Lesson Drawing,” in Journal of 
Public Policy, 1991. 

♦Rogers, E.M. The Diffusion of Innova- 
tions, New York, NY: The Free 
Press, 1983. 

♦♦Romero, C. et al. The Potential Ef- 
fectiveness of the Employment Ser- 
vice in Serving Dislocated Workers 
Under EDWAA: Evidence from the 
1980s, Washington, D.C.: National 
Commission for Employment Poli- 
cy, 1991. 

♦♦Secretary of Labor’s Task Force on 
Economic Adjustment and Worker 
Dislocation: Economic Adjustment 
and Worker Dislocation in a Com- 
petitive Society, 1986. 

♦Sleigh, S. (Editor) Economic Restruc- 
turing and Emerging Patterns of In- 
dustrial Relations, Kalamazoo, MI: 
W.E. Upjohn Institute for Employ- 
ment Research, 1993. 

♦♦Stromsdorfer, E.W. “Plant Closings 
and Worker Displacement,” in Eval- 
uation Forum, Issue #7, Summer 
1993. 

♦Summers, L. Understanding Unem- 
ployment, Cambridge, MA: MIT 
Press, 1990. 

♦♦Swigart, R.(Editor) Managing Plant 
Closures and Occupational Read- 
justment, Washington, D.C.: Nation- 
al Center for Occupational Readjust- 
ment, 1984. 

♦Tan, H. Technical Change and Its 
Consequences for Training and 
Earnings, A policy paper, Santa 
Monica, CA: The Rand Corporation, 
1987. 



CMC<« 



EvaluaUort Forum , Issue 11 . Summv199S 



145 




